-- Logs begin at Mon 2022-07-25 22:06:06 UTC, end at Mon 2022-07-25 23:32:59 UTC. -- Jul 25 23:01:11.991075 dv-osbrick-849021-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 23:01:11.999720 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 23:01:11 2022] *** Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: nodename: dv-osbrick-849021-3-ceph Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: machine: x86_64 Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: clock source: unix Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: pcre jit disabled Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: detected number of CPU cores: 4 Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: current working directory: / Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: detected binary path: /usr/bin/uwsgi-core Jul 25 23:01:12.001794 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: your processes number limit is 47680 Jul 25 23:01:12.002639 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: your memory page size is 4096 bytes Jul 25 23:01:12.002639 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: detected max file descriptor number: 2048 Jul 25 23:01:12.002639 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: lock engine: pthread robust mutexes Jul 25 23:01:12.002639 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: thunder lock: enabled Jul 25 23:01:12.002639 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 23:01:12.002639 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 23:01:12.046101 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: Python main interpreter initialized at 0x55a7144c39c0 Jul 25 23:01:12.046101 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: python threads support enabled Jul 25 23:01:12.046101 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: your server socket listen backlog is limited to 100 connections Jul 25 23:01:12.046101 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: your mercy for graceful operations on workers is 90 seconds Jul 25 23:01:12.047135 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 23:01:12.047234 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: *** Operational MODE: preforking *** Jul 25 23:01:12.047493 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: *** uWSGI is running in multiple interpreter mode *** Jul 25 23:01:12.047493 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: spawned uWSGI master process (pid: 87477) Jul 25 23:01:12.047689 dv-osbrick-849021-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 23:01:12.049236 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: spawned uWSGI worker 1 (pid: 87489, cores: 1) Jul 25 23:01:12.049236 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: spawned uWSGI worker 2 (pid: 87490, cores: 1) Jul 25 23:01:12.049236 dv-osbrick-849021-3-ceph devstack@keystone.service[87477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 23:01:17.810141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:01:17.810141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: from cryptography.utils import int_from_bytes Jul 25 23:01:17.810964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:01:17.810964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: from cryptography.utils import int_from_bytes Jul 25 23:01:17.811376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:01:17.811376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: from cryptography.utils import int_from_bytes Jul 25 23:01:17.811495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:01:17.811495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: from cryptography.utils import int_from_bytes Jul 25 23:01:17.860499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 23:01:17.860641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 23:01:17.860802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] command line args: [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 23:01:17.860905 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 23:01:17.861058 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 23:01:17.861143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 23:01:17.861221 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ================================================================================ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 23:01:17.861297 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] command line args: [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 23:01:17.861466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] admin_token = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.861553 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 23:01:17.861672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ================================================================================ {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 23:01:17.861751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config_dir = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.861884 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.861967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] admin_token = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862054 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config_source = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] config_dir = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] debug = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862679 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] config_source = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] debug = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.862947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863080 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863187 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863607 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.863912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_config_append = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864007 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_dir = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864313 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_config_append = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864416 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_dir = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864717 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864803 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_file = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.864921 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865084 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865214 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865291 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865486 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865698 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865777 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865900 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.865976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866178 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866632 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866716 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866866 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.866950 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867410 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867579 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867666 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.867951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868509 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] publish_errors = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868594 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868741 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] publish_errors = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.868965 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869260 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869573 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] standard_threads = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.869890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] standard_threads = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870386 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870543 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_journal = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870816 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_json = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.870893 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] use_journal = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_stderr = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] use_json = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_syslog = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] use_stderr = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] use_syslog = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871506 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871585 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:01:17.871662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.871826 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.871904 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872066 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872393 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872558 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872636 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.872870 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873038 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873272 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873759 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.873836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.874005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.874088 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.874796 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.874896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875486 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875732 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.875967 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876046 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876205 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876285 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.876941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.877926 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878410 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878503 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878718 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878873 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.878948 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879199 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879812 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.879901 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880288 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880365 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880763 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.880990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881760 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.881912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882000 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882391 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882710 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.882956 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883549 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883629 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883779 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.883855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884017 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884558 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.884947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885032 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885180 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885414 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885870 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.885948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886596 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.886918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887057 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887390 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887534 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887613 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887764 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.887996 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888731 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.888972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.889815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.890634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.890729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.890863 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.890941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891162 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891673 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891909 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.891996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892471 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892635 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892722 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892882 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.892966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893359 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893446 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893598 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893830 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.893910 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894539 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.894999 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895769 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.895925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896161 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896250 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.896901 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.external = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897580 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897733 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.external = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.897967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.password = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898733 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.token = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.password = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.898965 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] auth.token = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899280 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899441 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899528 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899671 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899914 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.899993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900159 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900392 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900480 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900870 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.900961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901364 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.901931 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.902384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.902468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.902627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.902721 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.902886 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.902967 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903202 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903689 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903886 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.903964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904218 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904454 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904628 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904861 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.904948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905343 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905423 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905788 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905909 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.905989 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906693 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.906951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907610 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907689 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.907933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908807 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.908886 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909511 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909591 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.909999 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910079 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910800 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.910957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911036 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911203 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911281 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911698 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.911944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912193 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912518 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912915 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.912995 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913607 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913844 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.913923 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914081 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914345 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914429 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.914909 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.915857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916243 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916329 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.916944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917417 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.917974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918716 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.918945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919205 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919353 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919668 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.919911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920281 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920366 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920526 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.920999 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921578 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921658 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.921922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922066 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922156 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922800 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.922893 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923028 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923256 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.923990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924463 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924543 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924773 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.924930 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925869 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.925947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926609 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926675 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926841 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.926921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927073 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927161 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927556 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927789 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.927876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928026 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.928964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929689 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.929925 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930015 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930174 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930432 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.930992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931230 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931386 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] role.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931702 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.931929 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] role.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932587 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932837 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.932917 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933082 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933167 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933409 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933656 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.933901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934184 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934313 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934409 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934565 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.934890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.935927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.936006 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.936176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.936254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.936425 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.936505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.936674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.937296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.937429 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.937545 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.937658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.937865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.937946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938211 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938485 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938737 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938866 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.938944 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939603 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.939926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940085 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940401 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.940869 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.941843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942345 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942521 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942604 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.942846 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943567 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943722 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.943968 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944760 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.944974 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.connection = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945569 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945803 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.945961 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946396 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.946920 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947007 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947631 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947718 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947875 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.947955 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948677 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948842 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.948919 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949070 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949543 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:01:17.949693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 23:01:17.949773 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 23:01:17.979332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.979559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.979645 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.979785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.980876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.980876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.988805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:17.988908 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.025524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.025749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.025926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.026164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.087584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.087826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.138474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.138695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.138833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.138967 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205008 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205675 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205826 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.205962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.206110 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.206246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.206405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.206536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.206536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.229186 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.229416 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.229550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.229692 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.229822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.229965 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230526 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230659 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230804 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230938 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.230938 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.242011 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.242553 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.255370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.255598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.255730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.255862 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.255992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256267 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256527 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.256934 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.257064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.257064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:01:18.274559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.274772 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:01:18.274918 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.275050 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:01:18.275180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.275310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:01:18.275451 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.275591 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:01:18.275720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.275864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.275993 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.276121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.276250 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.276387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.276517 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.276647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.286732 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287429 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287686 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.287896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.296883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.297297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.299898 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.300180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.300323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.300470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.300623 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.300759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.300838 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.300992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301085 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301336 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301522 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301605 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301795 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.301887 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302352 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.302896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.325793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.326190 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.327309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.328212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.328311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.328487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.332890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.333111 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.333209 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.333388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.333553 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.333780 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.340126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.340300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.340412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.340582 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.344626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.344761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.344914 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.345046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.345218 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.345338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.345502 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.345619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.345883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.346014 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.346162 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.346303 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.346479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.346760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.346844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.347050 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.363201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.363477 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.363643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.363781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.367430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.367701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.370611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.370859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.370956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.371154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.375480 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.375678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.378828 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.378929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.381966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.382050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.382263 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.382369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.382571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.382655 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.382970 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.383053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.383259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.383343 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.383540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.383633 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.400082 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.400189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.400321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.400465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.400590 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.400743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.400860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.401009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.408245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.408389 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.409934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.410211 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.410333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.410514 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.413026 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.413220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.413318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.413499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.413584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.413784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.413868 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.414072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.414165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.414375 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.426370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.426498 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.426651 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.426787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.426931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427020 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427212 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427306 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427591 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.427850 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.428040 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.428120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.443793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.444287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.446838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.447291 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.450837 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.451259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.452332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.452998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.453856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.454133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.454430 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.454533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.454721 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.455001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.563425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.564083 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.564951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.565605 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.567879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.568169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.568455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.568542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.568735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.568821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.569033 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.569308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.576765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.577048 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.577257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.577342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.577595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.578132 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.584350 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.584744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:01:18.585375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585509 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585679 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.585956 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586535 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586708 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.586981 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587256 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587527 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.587881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.588060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.588216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.588524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.588614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:01:18.623041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7144c39c0 pid: 87490 (default app) Jul 25 23:01:18.623167 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7144c39c0 pid: 87489 (default app) Jul 25 23:01:18.627105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df08100-5e30-4a82-baef-b01ee08fb902 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:18.627404 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df08100-5e30-4a82-baef-b01ee08fb902 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:18.627685 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df08100-5e30-4a82-baef-b01ee08fb902 None None] PATH_INFO: `/v3` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:18.631862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon Jul 25 23:01:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:27.623846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:27.624447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:27.624447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:27.628713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:01:27.634326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:27.634729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:27.634882 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:27.713865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: INFO dbcounter [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] Registered counter for database keystone Jul 25 23:01:27.735314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG oslo_db.sqlalchemy.engines [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:01:27.741377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writer thread running {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:01:27.921563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG passlib.handlers.bcrypt [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87490) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 23:01:27.922004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG passlib.handlers.bcrypt [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87490) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 23:01:27.975845 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:27.977473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:28.104346 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 23:01:28.241919 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:28.317932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: INFO dbcounter [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] Registered counter for database keystone Jul 25 23:01:28.336990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG oslo_db.sqlalchemy.engines [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:01:28.343666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writer thread running {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:01:28.462263 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf83ff-b658-4f43-9746-658365cc94a0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:28.466560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:28.467202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:28.467489 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:28.467769 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:28.476618 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:28.528836 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 23:01:28.529125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77bf45-4448-4138-bf7c-c421fb1c3c4f admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:28.540201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon Jul 25 23:01:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:01:28.546928 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:28.561298 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01fa5a-7d4b-4634-8d84-241541b96daa None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:28.565834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:28.566965 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:28.567252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:28.567531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] PATH_INFO: `/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:28.569020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] RBAC: Authorizing `identity:get_project(project_id=4fb3fc79734a41949ef7b41a3d86f9ef)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:28.619790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 23:01:28.620141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8450-0941-4c07-a492-28b0ffc6afaf admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:28.624876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon Jul 25 23:01:28 2022] GET /identity/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:30.810042 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eedfc3-fd90-4ee3-b297-5909e914fe80 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:30.810640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eedfc3-fd90-4ee3-b297-5909e914fe80 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:30.810640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eedfc3-fd90-4ee3-b297-5909e914fe80 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:30.815408 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:30.820900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760fb67-0708-424d-88b1-552f697191db None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:30.821335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760fb67-0708-424d-88b1-552f697191db None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:30.821463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760fb67-0708-424d-88b1-552f697191db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:30.842272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-6760fb67-0708-424d-88b1-552f697191db None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:30.843795 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-6760fb67-0708-424d-88b1-552f697191db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:30.851521 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 23:01:30.875717 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eedfc3-fd90-4ee3-b297-5909e914fe80 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:30.887455 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eedfc3-fd90-4ee3-b297-5909e914fe80 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:30.891947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505ce5-cd4f-40fd-88eb-5f78ae30db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:30.892547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505ce5-cd4f-40fd-88eb-5f78ae30db4c admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:30.892827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505ce5-cd4f-40fd-88eb-5f78ae30db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:30.893099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505ce5-cd4f-40fd-88eb-5f78ae30db4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:30.900628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505ce5-cd4f-40fd-88eb-5f78ae30db4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:30.902724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505ce5-cd4f-40fd-88eb-5f78ae30db4c admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:30.914412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon Jul 25 23:01:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 23:01:30.919774 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760fb67-0708-424d-88b1-552f697191db None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:30.929333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760fb67-0708-424d-88b1-552f697191db None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:30.933713 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38991a32-7aa1-4255-aadf-8a32c2996ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:30.934383 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991a32-7aa1-4255-aadf-8a32c2996ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:30.934665 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991a32-7aa1-4255-aadf-8a32c2996ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:30.934939 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991a32-7aa1-4255-aadf-8a32c2996ae3 admin admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:30.936300 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38991a32-7aa1-4255-aadf-8a32c2996ae3 admin admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:30.938829 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38991a32-7aa1-4255-aadf-8a32c2996ae3 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:30.940477 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon Jul 25 23:01:30 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:33.268592 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97eb7-2d04-41a1-b0bd-b8ab6df27233 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.269139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97eb7-2d04-41a1-b0bd-b8ab6df27233 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.269139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97eb7-2d04-41a1-b0bd-b8ab6df27233 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.270683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:33.275675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.276092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.276351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.296479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:33.297660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:33.330350 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c30c-17ba-4a02-ace2-ba6b62b5ae04 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.330640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c30c-17ba-4a02-ace2-ba6b62b5ae04 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.330919 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8c30c-17ba-4a02-ace2-ba6b62b5ae04 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.332257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:01:33.336945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.337232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.337513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.378012 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:33.378799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG passlib.handlers.bcrypt [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87489) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 23:01:33.379232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG passlib.handlers.bcrypt [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87489) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 23:01:33.402089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:33.425406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:33.426437 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:33.427037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:33.507668 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a1c06-acbe-4c11-b4c6-5fc5dbcde2dc None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:33.530854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:01:33.542120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:33.542801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.543088 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.543371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.554099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:33.554989 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:33.564067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:33.565203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:33.571153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:01:33.571820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:33.658103 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:33.661590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679c44-6aec-49d4-8fa5-5ed66814528d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:33.664372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:33.677049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc658e4-ca9f-4cc8-af7c-22ad536a327e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:33.702203 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:33.703097 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.703388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.703665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.711831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:33.712449 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.712740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.713064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.713783 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:33.714093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:33.715528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:33.728373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:33.734660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:33.773117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:33.774669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:33.835456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d318-e393-4e3a-b334-ad6fa8739f38 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:33.871183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:33.871826 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:33.872106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:33.872380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:33.873600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:33.874240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:01:33.875106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:33.876678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:33 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:33.880309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:33.881900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:33.883589 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:33.896470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:33.980806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb850-667a-423e-856d-2d8312222cc2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:33.982058 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d02021-8faf-4a69-a4bd-45935fddef3a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:34.013924 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862664dc-6818-46be-a161-c821c287d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:34.015327 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862664dc-6818-46be-a161-c821c287d31c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:34.015645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862664dc-6818-46be-a161-c821c287d31c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:34.015756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:34.015932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862664dc-6818-46be-a161-c821c287d31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:34.016384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:34.016672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:34.016982 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:34.018136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:34.019617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:34.021187 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:34.027022 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:34.036851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862664dc-6818-46be-a161-c821c287d31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:34.038362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862664dc-6818-46be-a161-c821c287d31c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-862664dc-6818-46be-a161-c821c287d31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:01:34.056274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:34.057100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:34.057892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:01:34.057892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:01:34.057892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:01:34.057892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:34.057892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:34.063496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862664dc-6818-46be-a161-c821c287d31c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:34.109164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:34.119163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:34.127678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f062e83-cc23-4af8-825b-c5699a6bbcf8 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:34.162743 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:34.163359 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:34.163636 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:34.163905 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:34.164304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862664dc-6818-46be-a161-c821c287d31c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:34.164691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.domain.id=default, user.id=77aed16721a7465ab3ea6f8255da3959) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:34.164994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:34.166476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcb780-9f8a-4f57-a563-dc4c236555a8 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:34.173559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Mon Jul 25 23:01:34 2022] GET /identity/v3/role_assignments?user.id=77aed16721a7465ab3ea6f8255da3959&scope.domain.id=default&role.id=b808049b0af24ba79f7b5a53a732242d => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:34.200863 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:34.201506 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:34.201782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:34.202049 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:34.203617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:34.204015 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:34.205465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff0da-bcd6-494c-a9c8-482f44cf3fe2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:34.227037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:36.779357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4f7a-ca5c-4bb7-80fd-a918c00188a9 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:36.779865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4f7a-ca5c-4bb7-80fd-a918c00188a9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:36.780742 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc4f7a-ca5c-4bb7-80fd-a918c00188a9 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:36.782395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:36.787806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:36.788643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:36.789119 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:36.815309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:36.816874 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:36.900084 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:36.940316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4f7a-ca5c-4bb7-80fd-a918c00188a9 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:37.075111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc4f7a-ca5c-4bb7-80fd-a918c00188a9 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:37.128926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b545e-e13f-49f5-aca9-cb4154d3dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:37.129926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b545e-e13f-49f5-aca9-cb4154d3dd9d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.130489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b545e-e13f-49f5-aca9-cb4154d3dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.130964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b545e-e13f-49f5-aca9-cb4154d3dd9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.151544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b545e-e13f-49f5-aca9-cb4154d3dd9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-665b545e-e13f-49f5-aca9-cb4154d3dd9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:37.158531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:37.159362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:37.160120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:37.162481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 13/24] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:37.168923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:37.237901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:37.292160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f1ef-98bc-4ab7-9b0d-9ea041fa2cb4 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.292787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f1ef-98bc-4ab7-9b0d-9ea041fa2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.293288 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f1ef-98bc-4ab7-9b0d-9ea041fa2cb4 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.297177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 14/25] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:37.303528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590378d5-b01a-4745-a903-449033b313f2 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.304056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590378d5-b01a-4745-a903-449033b313f2 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.304532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590378d5-b01a-4745-a903-449033b313f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.310305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a6858-7f15-4a6e-bcb5-3b2a33d03fee None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:37.327474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:37.346784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-590378d5-b01a-4745-a903-449033b313f2 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:37.348412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-590378d5-b01a-4745-a903-449033b313f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:37.381007 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:37.382033 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.382502 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.382920 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.383833 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:37.384287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:37.385879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:37.406715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 12/26] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:37.412219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:37.512071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:37.512071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f69b9-320a-444c-9a79-331c7135daf3 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.512071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f69b9-320a-444c-9a79-331c7135daf3 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.512071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f69b9-320a-444c-9a79-331c7135daf3 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.512071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 16/28] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:37.518203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f62a-3046-4449-b03c-3d17e82de45d None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.518522 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f62a-3046-4449-b03c-3d17e82de45d None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.518810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f62a-3046-4449-b03c-3d17e82de45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.543530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-61d2f62a-3046-4449-b03c-3d17e82de45d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:37.545120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-61d2f62a-3046-4449-b03c-3d17e82de45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:37.594065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b74ff-9a8c-408b-8ceb-1c3704b932f9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:37.608259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:37.635033 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 17/29] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:01:37.637247 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2a9fd-1502-42c5-8088-2a940d3bb732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:37.637857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da462-a2fd-4c65-bef8-c2e4de759513 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.638341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da462-a2fd-4c65-bef8-c2e4de759513 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.638525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a9fd-1502-42c5-8088-2a940d3bb732 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.639226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da462-a2fd-4c65-bef8-c2e4de759513 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.639344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a9fd-1502-42c5-8088-2a940d3bb732 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.639722 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2a9fd-1502-42c5-8088-2a940d3bb732 None admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.641164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 18/30] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:37.641762 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2a9fd-1502-42c5-8088-2a940d3bb732 None admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:37.642255 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168da462-a2fd-4c65-bef8-c2e4de759513 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:37.647475 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2a9fd-1502-42c5-8088-2a940d3bb732 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:37.649293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 13/31] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:37 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:37.650598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.650981 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.654678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.675367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:37.676665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:37.726093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:37.755238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 14/32] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:37.757240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:37.791584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168da462-a2fd-4c65-bef8-c2e4de759513 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:37.832310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:37.833269 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.833962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.834606 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.835694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:37.837404 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:37.888080 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bfce2-f541-4d7c-9807-16ee7179e204 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:37.896653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:37.924647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:37.925309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:37.925628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:37.925853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:37.927046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:37.928632 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:37.930372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 15/33] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:37.931142 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.043432 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a984-0497-4b1e-9fbc-20cd0d0e57fa None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.071294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 19/34] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 23:01:37 2022] POST /identity/v3/roles => generated 219 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:38.071491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.105091 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.107039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.107039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.107039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.128552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.130050 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:01:38.166925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:38.167822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:38.169107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:01:38.169107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:01:38.169107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:01:38.169107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:38.169107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 16/35] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:38.169107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.227072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:38.269572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4842b7-b7d6-42cb-8638-0d10e37cdd85 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.300087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:38.310844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.312422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.312862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.313276 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.314196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.316052 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.321812 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997237-26fc-4c95-8e49-7d8da6fee66c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.361263 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb49a6-61a9-4129-bcd1-96a4129d70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.362046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb49a6-61a9-4129-bcd1-96a4129d70c1 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.362455 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb49a6-61a9-4129-bcd1-96a4129d70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.362816 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb49a6-61a9-4129-bcd1-96a4129d70c1 None admin] PATH_INFO: `/v3/domains/default/users/77aed16721a7465ab3ea6f8255da3959/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.364865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb49a6-61a9-4129-bcd1-96a4129d70c1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=77aed16721a7465ab3ea6f8255da3959, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.366539 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb49a6-61a9-4129-bcd1-96a4129d70c1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.401145 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 20/36] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 23:01:38 2022] POST /identity/v3/roles => generated 225 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:38.402125 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.527863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af3826-7688-4931-bf84-9663edcf2f8f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.565693 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1361 bytes} [Mon Jul 25 23:01:38 2022] PUT /identity/v3/domains/default/users/77aed16721a7465ab3ea6f8255da3959/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:38.567655 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97c1b-cc3d-43ca-85d5-f25e1433f0fa None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.568077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97c1b-cc3d-43ca-85d5-f25e1433f0fa None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.568468 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97c1b-cc3d-43ca-85d5-f25e1433f0fa None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.569535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.570434 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.570866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.571428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.572299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:38.572817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.574473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.575479 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:38.582419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.582956 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.583405 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.612353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 21/39] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:38.618559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.618891 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:38.620734 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:38.687279 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:38.706505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:38.733785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:38.758878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c0fa-24a8-40ae-99d2-b245270af41a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.761183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:38.805910 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67b6a-c926-4837-bb21-bd4ac24c8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.806996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67b6a-c926-4837-bb21-bd4ac24c8924 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.807600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67b6a-c926-4837-bb21-bd4ac24c8924 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.807889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67b6a-c926-4837-bb21-bd4ac24c8924 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.808601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67b6a-c926-4837-bb21-bd4ac24c8924 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.810532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67b6a-c926-4837-bb21-bd4ac24c8924 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.859954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419fe0-c222-4254-870c-c975a43f94df None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:38.893881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:38.894531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.894821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.895095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.895813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:38.897364 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:38.925114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 22/41] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:01:38 2022] POST /identity/v3/projects => generated 301 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:38.926488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f908-f3f6-4216-8166-0b8f223d6513 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.926810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f908-f3f6-4216-8166-0b8f223d6513 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.927054 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f908-f3f6-4216-8166-0b8f223d6513 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.928451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 23/42] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:38.934023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:38.934343 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:38.934694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:38.956453 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:38.958002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:38.990334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 20/43] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 23:01:38 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:39.053077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 24/44] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:01:39.079966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:39.176418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:39.201719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa078-fddd-424d-b815-5295d36c49a5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:39.237989 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af52448-5e6a-4922-a6da-49702bb59c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:39.238682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52448-5e6a-4922-a6da-49702bb59c26 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.238964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52448-5e6a-4922-a6da-49702bb59c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.239240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52448-5e6a-4922-a6da-49702bb59c26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.241411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af52448-5e6a-4922-a6da-49702bb59c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:39.242981 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af52448-5e6a-4922-a6da-49702bb59c26 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:39.245138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 21/45] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:39.252132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:39.282929 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:39.354927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89efe3-9773-4901-ba5a-3a4d3430b9c1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:39.387387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58606-fb83-4243-a3be-663e05bf1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:39.388011 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58606-fb83-4243-a3be-663e05bf1c13 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:39.388290 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58606-fb83-4243-a3be-663e05bf1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:39.388583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58606-fb83-4243-a3be-663e05bf1c13 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:39.389260 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58606-fb83-4243-a3be-663e05bf1c13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:39.391465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58606-fb83-4243-a3be-663e05bf1c13 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:39.507585 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 25/46] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:01:39 2022] POST /identity/v3/projects => generated 312 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:40.868343 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfa6a5-fb47-4546-b908-05fdaa0d9452 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.868827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfa6a5-fb47-4546-b908-05fdaa0d9452 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.868827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfa6a5-fb47-4546-b908-05fdaa0d9452 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.870190 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 22/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:40.876227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:40.876635 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:40.876796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:40.894643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:40.895831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:40.965044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:40.989246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfa6a5-fb47-4546-b908-05fdaa0d9452 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.090274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfa6a5-fb47-4546-b908-05fdaa0d9452 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.122580 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.123150 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.123434 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.123715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.136617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:41.143402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:41.144471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:41.145231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:41.146427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 23/49] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:41.151359 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.162014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:41.250413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb9e2-c318-4870-91a0-0d26f5be63b5 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.284431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.285061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.285347 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.285654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.286414 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:41.286722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.288117 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.297715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 27/50] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:41.303412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.307234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:41.403197 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a3209-2c39-40e4-9f41-1a98ac6fdce4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.436138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.436885 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.437172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.437453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.438658 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.440119 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.441712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:41.447172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.515880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:41.547076 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a6461-df16-43bf-8724-ea9387cfc778 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.580608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d1d32-3cea-423d-bdb4-d003c2b7345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.581262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1d32-3cea-423d-bdb4-d003c2b7345c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.581549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1d32-3cea-423d-bdb4-d003c2b7345c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.581830 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1d32-3cea-423d-bdb4-d003c2b7345c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.582999 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d1d32-3cea-423d-bdb4-d003c2b7345c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.584455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d1d32-3cea-423d-bdb4-d003c2b7345c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.586306 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:41.592367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:41.665890 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:41.696368 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d45b-bfe0-4748-8e9d-629a74187c13 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:41.729547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:41.730171 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.730483 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.730766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.731554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.domain.id=default, user.id=77aed16721a7465ab3ea6f8255da3959) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:41.731865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:41.734002 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac023bd3-daca-4ee4-856f-b8bcbb7bd15e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:41.741947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1322 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/role_assignments?user.id=77aed16721a7465ab3ea6f8255da3959&scope.domain.id=default&role.id=b808049b0af24ba79f7b5a53a732242d => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:41.776275 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f589b-3015-4ca4-860d-de8154fe9f31 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.776684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f589b-3015-4ca4-860d-de8154fe9f31 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.777036 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f589b-3015-4ca4-860d-de8154fe9f31 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.778798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 29/54] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:41.785362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:41.785654 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:41.785940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:41.806026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:41.807326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:41.883197 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 26/55] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:41.908575 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f589b-3015-4ca4-860d-de8154fe9f31 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:42.015162 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f589b-3015-4ca4-860d-de8154fe9f31 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:42.048208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734b24d-dc68-47f4-83b1-12bf7ea01548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:42.048838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734b24d-dc68-47f4-83b1-12bf7ea01548 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:42.049121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734b24d-dc68-47f4-83b1-12bf7ea01548 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:42.049395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734b24d-dc68-47f4-83b1-12bf7ea01548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:42.050600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734b24d-dc68-47f4-83b1-12bf7ea01548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:42.052046 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734b24d-dc68-47f4-83b1-12bf7ea01548 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:42.053621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:42.059422 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:42.125488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:42.159487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fb4bc-8673-4ad5-96e4-0b5f7437e5d7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:42.193150 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0fff9-774d-48a5-8686-420135b4a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:42.193770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0fff9-774d-48a5-8686-420135b4a767 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:42.194050 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0fff9-774d-48a5-8686-420135b4a767 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:42.194348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0fff9-774d-48a5-8686-420135b4a767 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:42.195025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0fff9-774d-48a5-8686-420135b4a767 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:42.196469 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0fff9-774d-48a5-8686-420135b4a767 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:42.303653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Mon Jul 25 23:01:42 2022] POST /identity/v3/projects => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:01:44.516658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c337-4fa1-4dec-ab79-27b9d92a2d50 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:44.517181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c337-4fa1-4dec-ab79-27b9d92a2d50 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:44.517266 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c337-4fa1-4dec-ab79-27b9d92a2d50 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:44.518596 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:44.523672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:44.524061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:44.524231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:44.542271 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:44.543478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:44.611021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:44.636192 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c337-4fa1-4dec-ab79-27b9d92a2d50 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:44.645430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:44.738065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c337-4fa1-4dec-ab79-27b9d92a2d50 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:44.770910 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5653e57-76f1-401a-9aa4-42fd9ed8e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:44.771482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653e57-76f1-401a-9aa4-42fd9ed8e106 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:44.771768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653e57-76f1-401a-9aa4-42fd9ed8e106 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:44.772047 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653e57-76f1-401a-9aa4-42fd9ed8e106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:44.773303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5653e57-76f1-401a-9aa4-42fd9ed8e106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:44.774787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5653e57-76f1-401a-9aa4-42fd9ed8e106 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:44.776384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:44.782828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:44.830186 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:44.879926 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d1c90-0535-47bd-be04-a8da6b838e1b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:44.914244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4e2d-a75a-4b51-81f1-2f0ee1b79d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:44.914889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4e2d-a75a-4b51-81f1-2f0ee1b79d4b None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:44.915173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4e2d-a75a-4b51-81f1-2f0ee1b79d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:44.915452 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4e2d-a75a-4b51-81f1-2f0ee1b79d4b None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:44.916142 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a4e2d-a75a-4b51-81f1-2f0ee1b79d4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:44.917601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a4e2d-a75a-4b51-81f1-2f0ee1b79d4b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:45.013238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:01:44 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:48.378356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e720b-fa09-441d-aa90-d155831487eb None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.379475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e720b-fa09-441d-aa90-d155831487eb None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.380088 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e720b-fa09-441d-aa90-d155831487eb None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.381800 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:48.387948 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd612-ecb0-4a8d-9e81-29b4feaec4df None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.388402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd612-ecb0-4a8d-9e81-29b4feaec4df None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.388574 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd612-ecb0-4a8d-9e81-29b4feaec4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.415521 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-814bd612-ecb0-4a8d-9e81-29b4feaec4df None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:48.417153 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-814bd612-ecb0-4a8d-9e81-29b4feaec4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:48.515540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:01:48.558457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e720b-fa09-441d-aa90-d155831487eb None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:48.583829 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e4b3-4a79-40fa-82c7-c53921b3911c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.584456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e4b3-4a79-40fa-82c7-c53921b3911c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.595871 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e4b3-4a79-40fa-82c7-c53921b3911c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.598971 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:48 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:48.605043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.605332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.605617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.638019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:48.639364 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:48.698727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:48.711538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:48.752670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:48.780220 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e720b-fa09-441d-aa90-d155831487eb None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:48.782098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:48.879765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:48.880446 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.880895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.881352 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.896037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07920bb-283c-4bbb-adaa-b5edd14f7858 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:48.923062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:48.928711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:48.929848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:01:48.930863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:48.938068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 34/66] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:48.940070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:48.949747 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80725aba-d2a0-400d-9d83-7724c9d1305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:48.950470 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725aba-d2a0-400d-9d83-7724c9d1305d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.950758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725aba-d2a0-400d-9d83-7724c9d1305d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.951044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725aba-d2a0-400d-9d83-7724c9d1305d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.968386 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80725aba-d2a0-400d-9d83-7724c9d1305d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-80725aba-d2a0-400d-9d83-7724c9d1305d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:48.975393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:48.976220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:48.976987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 33/67] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:48.984091 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170c63a-b3cd-4da7-9c14-dd891db77214 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:48.984937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170c63a-b3cd-4da7-9c14-dd891db77214 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:48.985233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170c63a-b3cd-4da7-9c14-dd891db77214 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:48.987294 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 34/68] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:48.992065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170c63a-b3cd-4da7-9c14-dd891db77214 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.038721 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.067388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726869a7-6ca4-4b0b-bb3d-78e9f8b6e88d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.103611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.104531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.104816 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.105093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.105807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:49.106109 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.107536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305d55a-2c8e-4cbb-854d-a23712943087 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.109365 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.117002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:49.117600 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170c63a-b3cd-4da7-9c14-dd891db77214 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.118489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.120715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.120715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.136406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:49.137597 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:49.153155 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.153716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.154053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.154378 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.155874 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:49.156192 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.157607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caa33b-a992-43df-949e-0fa4a60e9ce3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.165563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:01:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:49.166759 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627bae5-7d90-4153-b85c-06da3a4e64be None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.167202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627bae5-7d90-4153-b85c-06da3a4e64be None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.167484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627bae5-7d90-4153-b85c-06da3a4e64be None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.170647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 36/71] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:49.170647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638022-3ef4-49d5-94e0-2322da580a48 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.170647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638022-3ef4-49d5-94e0-2322da580a48 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.170647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638022-3ef4-49d5-94e0-2322da580a48 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.171496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 37/72] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:49.172333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a638022-3ef4-49d5-94e0-2322da580a48 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.211497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 36/73] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:49.212172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.266188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.282308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a638022-3ef4-49d5-94e0-2322da580a48 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.312752 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f484da-c368-4d5c-b044-2319fc7e169b None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.316183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c187fe-95c2-4e92-a303-0c5a844f84fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.316831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c187fe-95c2-4e92-a303-0c5a844f84fd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.317117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c187fe-95c2-4e92-a303-0c5a844f84fd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.317398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c187fe-95c2-4e92-a303-0c5a844f84fd None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.332453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c187fe-95c2-4e92-a303-0c5a844f84fd None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.333908 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c187fe-95c2-4e92-a303-0c5a844f84fd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.335614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:49.336763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.337053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.337333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.338525 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.347763 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552b4df-beee-4542-9d4c-0ad97379e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.351827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552b4df-beee-4542-9d4c-0ad97379e723 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.351827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552b4df-beee-4542-9d4c-0ad97379e723 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.351827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552b4df-beee-4542-9d4c-0ad97379e723 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.351827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552b4df-beee-4542-9d4c-0ad97379e723 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.351827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552b4df-beee-4542-9d4c-0ad97379e723 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.353239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:49.356484 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.356484 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.356656 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:49.356730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.357243 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:49.374231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:49.375448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:49.425692 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 39/76] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:49.426474 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.443106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 38/77] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:49.443879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.508164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.532742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92549ab-362b-4480-bd28-12b68702e50a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.544254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addca0db-9b56-413c-bbf7-c1773a66f5e3 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.567059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.567709 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.567991 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.568273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.568419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.578899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:49.579578 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.580218 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.583746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.583746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:49.583898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:49.584725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:49.585485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 40/78] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:49.586115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.655946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.657420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.692081 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec944a-75d8-44da-a057-99c3d9701585 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.728147 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.728774 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.729058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.729383 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.732044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.757357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:01:49.759217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.786198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:49.798141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:49.799671 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:49.859782 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80014-7942-4673-a78b-af3a9c0c2e05 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:49.893620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:49.894276 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:49.894681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:49.894865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:49.902512 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 41/80] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:01:49.903367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.905897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:49.910812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:49.911847 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:49.912971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:49.915141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:49.940043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.001209 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.003234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a12d8-0ac3-420c-af4c-b3a564a7ebe2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.016690 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44b71-3b8e-470e-9c9a-3e91ef5eb795 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.038883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.039560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.039847 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.040122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.041270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.042777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.044542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.045113 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.056505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.057133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.057417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.057696 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.058457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:50.058768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.060180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.069264 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 41/83] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.070078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.146439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b6a63-8c68-434f-9e61-a5f7758b61b8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.148066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.174694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bf24b-583e-497a-8098-c584c83ae583 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.181461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.182109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.182444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.182724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.183891 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.185684 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.188088 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.188947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.210886 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.211535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.211820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.212100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.213251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.214787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.216377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.217640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.232668 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.289780 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf6c9-6f7d-4e05-a0c1-31e4ffc51770 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.317676 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab843ca-c084-4943-aac0-5f0a7a60a45d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.322713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.323335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.323616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.323893 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.324608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:50.324916 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.326305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.335385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 44/86] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.335998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.355135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.355769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.356054 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.356342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.357025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.358713 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.367997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.438536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65babf-5cee-4f90-904a-aa1c2eb3960a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.472225 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.472866 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.473153 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.473436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.474231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 43/87] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:01:50 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:50.474884 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.475208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.476149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.477765 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 45/88] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.479176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.570463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.607365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.611568 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c624e6-9d85-4246-91e4-33f3d2a828e6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.615189 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9784-6e04-4629-83a8-39a9c9b39066 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.649780 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.651318 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.651630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.651896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.652947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=466bf745aeca4805912f77525bf77d11) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:50.653984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.654339 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.655029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.655549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.655549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.655767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.656535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] RBAC: Adding query filter params (role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=466bf745aeca4805912f77525bf77d11) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:50.657046 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.658539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.664510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 44/89] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/role_assignments?user.id=466bf745aeca4805912f77525bf77d11&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=75ed1976f12e48b38908f23e51856c1e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.665358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.670944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/role_assignments?user.id=466bf745aeca4805912f77525bf77d11&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=def5a58760984080ab8717cb294b3f64 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.672126 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.817251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a44bd-244e-4179-acb7-6019f96a7929 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.823502 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1994c83-c045-45af-9edf-fbd92de5956b None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:50.860577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.861225 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.861514 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.861798 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.863450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:50.864993 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:50.865367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:50.865721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:50.867187 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.868823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:50.872266 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 45/91] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:50.878310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:50.883181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.901350 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.954808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:50.957039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.017237 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d225e4-7c33-44c9-b471-31f5afed2232 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.056425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.057071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.057360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.057644 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.083788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 47/92] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:01:51.091038 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.139300 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.140831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.146599 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:51.213394 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:51.265595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358c3f-20c9-474a-b387-ae246de4b03b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.285017 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 46/93] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:01:51.291465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.303119 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.304144 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.304627 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.305114 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.306542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.308207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.310124 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:51.317246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.415035 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ded6-51d5-4054-9e00-6c62fb22b592 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.416945 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:51.455268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.456358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.456854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.457342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] PATH_INFO: `/v3/projects/d8595b2efe954cde80da195ed845ca5f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.458811 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] RBAC: Authorizing `identity:get_project(project_id=d8595b2efe954cde80da195ed845ca5f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.460880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.463614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 47/95] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/projects/d8595b2efe954cde80da195ed845ca5f => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:51.470659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:51.536302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09113786-df6d-42a8-9d20-4e3e9447029b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.571677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:51.578489 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.579430 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.580244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.580741 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.582001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=77aed16721a7465ab3ea6f8255da3959) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:51.582547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.588813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde909a-e878-4a6a-a496-67afb81a053d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.590885 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/role_assignments?user.id=77aed16721a7465ab3ea6f8255da3959&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=b808049b0af24ba79f7b5a53a732242d => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:51.682623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d23c4a-bbfc-4294-abe4-d6dcfe8317df None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:51.745418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:51.746059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:51.746373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:51.746660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:51.747475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=d8595b2efe954cde80da195ed845ca5f, user.id=466bf745aeca4805912f77525bf77d11) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:51.747793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:51.749815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d55c-c037-4684-bbee-23ce91448e89 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:51.758852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:01:51 2022] GET /identity/v3/role_assignments?user.id=466bf745aeca4805912f77525bf77d11&scope.project.id=d8595b2efe954cde80da195ed845ca5f&role.id=def5a58760984080ab8717cb294b3f64 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:53.820583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664d85-1308-4a00-aebf-f9f6a31cd265 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:53.821640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664d85-1308-4a00-aebf-f9f6a31cd265 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:53.822137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664d85-1308-4a00-aebf-f9f6a31cd265 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:53.823735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:53.829476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:53.830386 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:53.830931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:53.854781 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:53.856282 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:53.885539 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6862ea8-aaae-4cff-8f06-fb6bffd01867 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:53.885859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6862ea8-aaae-4cff-8f06-fb6bffd01867 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:53.886101 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6862ea8-aaae-4cff-8f06-fb6bffd01867 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:53.895692 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 51/99] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:53.896220 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:53.928499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eee8a-f93a-48a1-b77d-3114aaefca03 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:53.929200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eee8a-f93a-48a1-b77d-3114aaefca03 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:53.929695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eee8a-f93a-48a1-b77d-3114aaefca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:53.947318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 49/100] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:53.968979 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-cb8eee8a-f93a-48a1-b77d-3114aaefca03 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:53.970191 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-cb8eee8a-f93a-48a1-b77d-3114aaefca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:53.977959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.118545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 23:01:54.119754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b122a-7911-4739-ab92-7ea5896b93e5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.120049 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b122a-7911-4739-ab92-7ea5896b93e5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.120332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b122a-7911-4739-ab92-7ea5896b93e5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.130788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 53/102] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:54.147945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.153748 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.153748 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.163033 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32ca1d-76c9-4e03-8786-972010946d26 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.180155 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:54.181702 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:54.238218 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.240508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.241022 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.241510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.244753 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:54.247284 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:54.249728 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 50/103] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:01:54.255530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.307322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.359571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 54/104] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:01:54.362778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.416809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f7ca4-6876-476a-8a6d-2f692ee431db None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.466410 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.468795 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.469305 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.470831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.485518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.496244 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:54.507413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:54.508391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:54.509182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 51/105] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:01:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:54.509852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.550018 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85bf27-c0e2-4717-8bd1-48b73ee3597c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.599662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8748d-b5b3-4db6-8299-4bd31e50b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.600883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8748d-b5b3-4db6-8299-4bd31e50b349 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.601559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8748d-b5b3-4db6-8299-4bd31e50b349 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.601978 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8748d-b5b3-4db6-8299-4bd31e50b349 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.603012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8748d-b5b3-4db6-8299-4bd31e50b349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:54.604924 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8748d-b5b3-4db6-8299-4bd31e50b349 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:54.610986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.619188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e31ae-5ca2-4f56-8eb4-70fe68bc3ac4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.656356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1a0f-782e-458b-8155-b9c828d761c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.657245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1a0f-782e-458b-8155-b9c828d761c4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.657637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1a0f-782e-458b-8155-b9c828d761c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.657994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1a0f-782e-458b-8155-b9c828d761c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1a0f-782e-458b-8155-b9c828d761c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-55cc1a0f-782e-458b-8155-b9c828d761c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:54.674789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:54.675767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:54.676924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 52/106] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:54.679552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ec9e0-02fe-4de8-a804-37ca503357c7 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.679919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ec9e0-02fe-4de8-a804-37ca503357c7 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.680268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ec9e0-02fe-4de8-a804-37ca503357c7 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.685450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 53/107] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:54.685450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ec9e0-02fe-4de8-a804-37ca503357c7 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.701111 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 55/108] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/projects => generated 302 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:54.702760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163cf57-7da1-4b7b-9238-c1d91eb14dc4 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.703055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163cf57-7da1-4b7b-9238-c1d91eb14dc4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.703332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163cf57-7da1-4b7b-9238-c1d91eb14dc4 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.704606 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 56/109] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:54.705421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163cf57-7da1-4b7b-9238-c1d91eb14dc4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:54.824382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ec9e0-02fe-4de8-a804-37ca503357c7 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.850599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163cf57-7da1-4b7b-9238-c1d91eb14dc4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:54.865119 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.872726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.874200 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.874756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.875308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.876269 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:54.876903 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:54.878675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59139fd-5d8b-45bc-8756-85ecc3483683 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:54.894671 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 54/110] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:01:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:54.895834 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:54.896472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.896751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.897027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.897388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.897752 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:54.898063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:54.898311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.898798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.899537 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dab2f-6783-4b82-80f9-6da26c8d96e3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:54.917591 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 57/111] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:01:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:54.923998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:54.923998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:54.923998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:54.924280 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:54.924280 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:54.935339 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:54.943805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:54.946008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.015044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 55/112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:55.016177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.039094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:55.040760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.167081 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.171430 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452109ac-8a6d-4f5c-be5d-ee17d6e988a3 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.172080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a5f2-b6ad-4cac-a3e9-3a9e644e3919 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.212409 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.213304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.213740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.214188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.215695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.216024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.216862 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.217850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.218233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.219041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.219834 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.221135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 56/114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:55.222336 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.226326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.228781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 59/115] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:55.234564 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.249534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.365818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc863-d22b-41b8-aaf1-33814a2ea6f7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.367104 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1172f5d-0c82-4a12-8e93-b30882be66b8 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.406972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.407848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.408234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.408615 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.408707 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.409335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.409618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.409891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.419906 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:55.420863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:55.425154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:55.426198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:01:55.427131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:55.427741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:55.428608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 57/116] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:55.429369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.434448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 60/117] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:55.434448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.468244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.505401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.537418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e144fc-ae33-4968-b413-7e65a074237c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.544533 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac977ee-54eb-476a-9a14-b54df7a13e18 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.574168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84211e-810a-40b3-8a67-7e4059ae6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.574863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84211e-810a-40b3-8a67-7e4059ae6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.575151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84211e-810a-40b3-8a67-7e4059ae6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.575435 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84211e-810a-40b3-8a67-7e4059ae6fb1 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.577416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84211e-810a-40b3-8a67-7e4059ae6fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.579015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84211e-810a-40b3-8a67-7e4059ae6fb1 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.580926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 58/118] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:55.582023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ebfa4-8066-4548-badf-8085cd58c35d None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.582335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ebfa4-8066-4548-badf-8085cd58c35d None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.583136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ebfa4-8066-4548-badf-8085cd58c35d None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.583994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 59/119] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:55.584549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ebfa4-8066-4548-badf-8085cd58c35d None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.591974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.592794 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.593079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.593358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.595972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.597443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.603612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 61/120] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:55.603612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.702173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.708089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ecfe-1b73-4d9c-b14c-0426b88a2b0f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.709474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ebfa4-8066-4548-badf-8085cd58c35d None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.743266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.743881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.744234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.744585 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.744694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.745310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.745485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:55.745581 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.745864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.745956 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.746604 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:55.746912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.747550 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.749165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cd0ef-d959-406d-959a-4940da44f51f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.761445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 62/121] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:55.761445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.761682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 60/122] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:01:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:55.761682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.761682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.761682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.767328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:55.779266 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:55.780536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:55.858319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 61/123] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:55.858319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:55.871809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530989e-aa05-4450-848f-4f3dde606048 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:55.908072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:55.908763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:55.909051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:55.909331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f/users/466bf745aeca4805912f77525bf77d11/roles/75ed1976f12e48b38908f23e51856c1e` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:55.911630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1754e4951234624ac0ae407c871458f, user_id=466bf745aeca4805912f77525bf77d11, role_id=75ed1976f12e48b38908f23e51856c1e)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:55.913088 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:55.971416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3dca5-b503-41a3-ad4f-345aebe38c9c None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.001179 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.006057 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.006792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.008661 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.008661 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f/users/466bf745aeca4805912f77525bf77d11/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.009291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1754e4951234624ac0ae407c871458f, user_id=466bf745aeca4805912f77525bf77d11, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.010815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.014361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 63/124] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:01:55 2022] PUT /identity/v3/projects/a1754e4951234624ac0ae407c871458f/users/466bf745aeca4805912f77525bf77d11/roles/75ed1976f12e48b38908f23e51856c1e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:56.020777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.043680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.094144 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 62/125] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:01:55 2022] PUT /identity/v3/projects/a1754e4951234624ac0ae407c871458f/users/466bf745aeca4805912f77525bf77d11/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:56.094840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.188941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef54a1-ff8a-4033-aaf6-f10ec4e0e541 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.239498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e6d3-cb0d-43ed-b162-8daad6d68ff2 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.243802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.244092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.244373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.244653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.245874 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.247464 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.250026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:56.251012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.288552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.290137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.290642 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.291272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] PATH_INFO: `/v3/users/91f2c0f45e21432b90f00d30537cc1c7` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.312917 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] RBAC: Authorizing `identity:get_user(user_id=91f2c0f45e21432b90f00d30537cc1c7)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.315397 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.317370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 63/127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/users/91f2c0f45e21432b90f00d30537cc1c7 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:56.318359 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.369697 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.383928 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.391936 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e39ef5-6144-475d-b7e1-5400c297b6f8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.440146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.441180 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.441660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.442138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.450753 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787ac9-461c-4e6b-930d-50599fa517a6 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.454209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:56.459831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:56.460690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:56.461450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:56.463781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 65/128] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:56.464784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.490855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.491577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.491861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.492136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.493385 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.495089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.496838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 64/129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:56.497860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.584170 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e5d2-5f9f-4035-b6eb-69083edaf657 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.614141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2c01-c03a-4c8f-83ff-9825d7a17578 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.621899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.622808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.624543 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.625024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.632876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.643783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.653334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.654639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.654960 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.655368 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.656216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:56.656664 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.658325 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.667320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 65/130] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:56.668642 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.702957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.704828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.777489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d531424-807d-4193-a33e-bd56f5a18d12 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.812913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 66/131] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:01:56.813927 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.818171 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.819113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.819576 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.819999 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f/users/77aed16721a7465ab3ea6f8255da3959/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.822119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1754e4951234624ac0ae407c871458f, user_id=77aed16721a7465ab3ea6f8255da3959, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.823733 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.870062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:56.929831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d287f-d06b-4c59-90d8-f73b6957a7f4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:56.932387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 66/132] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:01:56 2022] PUT /identity/v3/projects/a1754e4951234624ac0ae407c871458f/users/77aed16721a7465ab3ea6f8255da3959/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:56.933571 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:56.970302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:56.971001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:56.971572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:56.973559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:56.975974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:56.978559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:56.982608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 67/133] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:56.991404 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.040158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:57.179281 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ccd0-6e9f-4548-a1d5-c9af0b6029d4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.218606 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b081777-7157-4580-ad0b-afa6c6df8dbf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.226510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.227186 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.227473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.227755 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.228998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.230624 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.233198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 67/134] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:57.239302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.251724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:57.290414 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f58a9-6db7-4bd1-9467-d63250cc5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.291203 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f58a9-6db7-4bd1-9467-d63250cc5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.291575 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f58a9-6db7-4bd1-9467-d63250cc5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.292401 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f58a9-6db7-4bd1-9467-d63250cc5fc6 None admin] PATH_INFO: `/v3/projects/d8595b2efe954cde80da195ed845ca5f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.293951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f58a9-6db7-4bd1-9467-d63250cc5fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=d8595b2efe954cde80da195ed845ca5f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.296315 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f58a9-6db7-4bd1-9467-d63250cc5fc6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.298548 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 68/135] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:01:56 2022] GET /identity/v3/projects/d8595b2efe954cde80da195ed845ca5f => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:57.302515 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6ea53-acca-4adb-89c2-a36ac60ae867 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.304318 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6ea53-acca-4adb-89c2-a36ac60ae867 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.305162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6ea53-acca-4adb-89c2-a36ac60ae867 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.307915 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 69/136] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:57.312133 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6ea53-acca-4adb-89c2-a36ac60ae867 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.462249 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eb705-a60f-44a3-9a54-3134a87184d0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.466515 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6ea53-acca-4adb-89c2-a36ac60ae867 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.480762 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:57.505039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.505790 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.506077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.506445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] PATH_INFO: `/v3/projects/d8595b2efe954cde80da195ed845ca5f/users/466bf745aeca4805912f77525bf77d11/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.508388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8595b2efe954cde80da195ed845ca5f, user_id=466bf745aeca4805912f77525bf77d11, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.509851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.532700 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.533327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.534262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.534262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.534901 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] RBAC: Adding query filter params (role.id=b233f3c68dc749d1808da33222469071, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=91f2c0f45e21432b90f00d30537cc1c7) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:57.535405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.536879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171c2e5-b30d-4a14-9318-67b46da539e2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.543717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 68/137] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:01:57 2022] GET /identity/v3/role_assignments?user.id=91f2c0f45e21432b90f00d30537cc1c7&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=b233f3c68dc749d1808da33222469071 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:57.545008 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.545399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.545769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.567684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:57.568984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:57.588082 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:01:57 2022] PUT /identity/v3/projects/d8595b2efe954cde80da195ed845ca5f/users/466bf745aeca4805912f77525bf77d11/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:57.693349 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:57.738214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:57.806412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:57.884501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5f7b6-e23a-4ae1-8578-563bcd9b5532 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:57.932899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54280583-57d1-4daa-bba1-514edfe7784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:57.933641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280583-57d1-4daa-bba1-514edfe7784e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:57.933836 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280583-57d1-4daa-bba1-514edfe7784e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:57.934122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54280583-57d1-4daa-bba1-514edfe7784e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:57.939066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280583-57d1-4daa-bba1-514edfe7784e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:57.940665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54280583-57d1-4daa-bba1-514edfe7784e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:57.942555 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 71/140] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:57.947895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:58.086416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248f3b1-a37c-41eb-840c-4f894d7e6b11 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:58.088131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:58.132367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee0d94-f2f1-44b3-a88a-3e77866f677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:58.133005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0d94-f2f1-44b3-a88a-3e77866f677c None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:58.133291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0d94-f2f1-44b3-a88a-3e77866f677c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:58.133575 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0d94-f2f1-44b3-a88a-3e77866f677c None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:58.134293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee0d94-f2f1-44b3-a88a-3e77866f677c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:58.135787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee0d94-f2f1-44b3-a88a-3e77866f677c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:58.230960 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 70/141] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:01:57 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:01:59.083871 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc766ca-87f3-4e6b-ba75-ae5b4023f832 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.084367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc766ca-87f3-4e6b-ba75-ae5b4023f832 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.084472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc766ca-87f3-4e6b-ba75-ae5b4023f832 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.085791 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 72/142] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:59.091342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1b591-2c72-49f0-90d8-0e27debc7359 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.092997 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1b591-2c72-49f0-90d8-0e27debc7359 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.093545 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1b591-2c72-49f0-90d8-0e27debc7359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.119468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-7bd1b591-2c72-49f0-90d8-0e27debc7359 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:59.121093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-7bd1b591-2c72-49f0-90d8-0e27debc7359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:59.200674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:01:59.239400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc766ca-87f3-4e6b-ba75-ae5b4023f832 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.323691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdebafb-63a9-4a0a-9a83-16a806478c1d None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.324378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdebafb-63a9-4a0a-9a83-16a806478c1d None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.324857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdebafb-63a9-4a0a-9a83-16a806478c1d None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.327001 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 72/144] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:01:59.335062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.335613 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.335900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.364491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:59.365692 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:59.405333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc766ca-87f3-4e6b-ba75-ae5b4023f832 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:59.424519 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:59.473397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:59.474312 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.474626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.476403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.504588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:59.512139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:59.512970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:01:59.513974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:59.515053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 73/145] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:01:59.515188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 73/146] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:01:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:01:59.519535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.542426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:59.564611 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.694358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020ac0b-c115-468a-bac7-0cb70a8cb703 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:59.706317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b33091-ff92-4147-ba3c-6748f43c3487 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:59.766035 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:59.766977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.767264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.767546 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.773878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:59.774537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.774820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.775092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.775822 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:01:59.776126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:59.777761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:59.792273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:01:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:01:59.795043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:01:59.798407 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:01:59.800736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:01:59.801646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:01:59.802444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 74/148] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:01:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:01:59.815540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:59.872818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:59.959976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:59.968739 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d47761-1301-4c34-909b-213e46c3d054 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:59.983643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5b33-3ebb-4b8c-b099-b22ffafe4b82 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.020973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.022102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.022630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.023109 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.025322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.027287 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.030027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 75/149] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:01:59 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:00.035821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.038016 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.038696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.038978 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.039322 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.040058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:00.040362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.041777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.057857 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 75/150] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:00.063701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.147922 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d2c25-60fa-4ab0-a38d-0cc40809f561 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.186215 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.187247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.187745 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.188234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.208013 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:00.264840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.267027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.329107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:00.346470 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9359-3d67-46ea-b7d5-8f5b49931fb3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.378242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 76/151] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:00.383986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.399522 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.403012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.403451 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.403901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.405632 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.407267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.409332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 76/152] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:00.419239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.435370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:00.494143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035d57-5366-4c4d-9eb5-14e71c5d1231 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.531746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.532646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.533074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.533532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.535053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.536666 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.538832 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 77/153] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:00.544846 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.565077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4cd9-163d-4fa8-876f-6d4de5ad0c31 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.613416 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.618377 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.618896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.619326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.658788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:00.663369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb22c-8cba-449e-b7c0-c9c30559a5d0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:00.681429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:00.702318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:00.703361 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:00.703791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:00.704227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:00.705189 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] RBAC: Adding query filter params (role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=466bf745aeca4805912f77525bf77d11) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:00.705645 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.707275 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.714035 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/role_assignments?user.id=466bf745aeca4805912f77525bf77d11&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=75ed1976f12e48b38908f23e51856c1e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:00.721741 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:00.723319 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:00.866369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 77/155] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:00.871682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:00.996555 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816c8a7-0f1d-4942-bfec-c9dac3524ec3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:01.035382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3cd2d-55c4-4a01-9742-c440bd30d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:01.036041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3cd2d-55c4-4a01-9742-c440bd30d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.036322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3cd2d-55c4-4a01-9742-c440bd30d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.036595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3cd2d-55c4-4a01-9742-c440bd30d2a6 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.037761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3cd2d-55c4-4a01-9742-c440bd30d2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:01.039227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3cd2d-55c4-4a01-9742-c440bd30d2a6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:01.041038 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 79/156] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:00 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:01.047688 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:01.110147 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:01.153105 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a3196-af6a-4205-b700-2ae43d3d27fb None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:01.188680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:01.189317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.189599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.189876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.190703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=466bf745aeca4805912f77525bf77d11) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:01.191246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:01.192687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3ba9d-2659-469f-991e-76be18a7a67b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:01.199569 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 78/157] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:01 2022] GET /identity/v3/role_assignments?user.id=466bf745aeca4805912f77525bf77d11&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=def5a58760984080ab8717cb294b3f64 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:01.353448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b122-ea4f-48ae-bd1e-ecb0790a4fda None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.354403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b122-ea4f-48ae-bd1e-ecb0790a4fda None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.354882 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b122-ea4f-48ae-bd1e-ecb0790a4fda None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.356443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 80/158] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:01.362744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.363685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.364172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.387050 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:01.388743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:01.421391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94888b9-fb41-4f08-b404-9ce833c7a1cd None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.422071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94888b9-fb41-4f08-b404-9ce833c7a1cd None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.422594 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94888b9-fb41-4f08-b404-9ce833c7a1cd None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.424476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 81/159] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:01.430114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.430711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.431192 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.453740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:01.456473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:01.474443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 79/160] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:01.542825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:01.555996 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:01.598557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:01.627328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:01.648404 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:01.706941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb0d08-a904-443a-bc05-7419e8b8ac19 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:01.752142 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:01.753144 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.753639 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.754112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.765620 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:01.777331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:01.778214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:01.779099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:01.781861 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 80/162] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:01.789937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:01.838408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250e14-54ec-4173-92c5-337b8a286025 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:01.896432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:01.897005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:01.897284 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:01.897564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:01.919479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:01.925174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:01.926096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:01.926908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:01.934441 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:01.936637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:01.976129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543919-a9e0-4acb-b972-930e81428985 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:01.994975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.000429 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.048335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.049360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.049843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.050390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.051401 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:02.051904 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.053562 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716e97e-76f5-4ddf-9d0d-eed8b606c600 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.066092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29375008-5e1b-417b-ac31-c12bd20fbca3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.068817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 81/164] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:02.070311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f69f-78f2-40f4-9d29-fb81339cfa0b None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.070806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f69f-78f2-40f4-9d29-fb81339cfa0b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.071285 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f69f-78f2-40f4-9d29-fb81339cfa0b None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.072710 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 82/165] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:02.083165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f69f-78f2-40f4-9d29-fb81339cfa0b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.103978 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.104609 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.107068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.107068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.107068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:02.107068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.108303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f643934-28d2-4e1d-bd56-186489c8b1c0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.117756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 84/166] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:02.123966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.124256 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.124538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.162396 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:02.163535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:02.247115 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 85/167] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:02.249528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.284072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.359219 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638be199-0a18-4c7b-b2ef-da62e70d2884 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.395407 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.396165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.396511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.396863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] PATH_INFO: `/v3/users/91f2c0f45e21432b90f00d30537cc1c7` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.398116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] RBAC: Authorizing `identity:get_user(user_id=91f2c0f45e21432b90f00d30537cc1c7)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.399650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.401639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 86/168] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/users/91f2c0f45e21432b90f00d30537cc1c7 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:02.402739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.411320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f69f-78f2-40f4-9d29-fb81339cfa0b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.516914 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5657c35-fd10-47c8-b993-9efc0db2782c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.518802 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.555509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.556224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.556508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.556836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.568293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:02.568769 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.569888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.570421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.570900 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] PATH_INFO: `/v3/users/77aed16721a7465ab3ea6f8255da3959` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.572905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] RBAC: Authorizing `identity:get_user(user_id=77aed16721a7465ab3ea6f8255da3959)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:02.573285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:02.574126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:02.574943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 87/169] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:02.576584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.583967 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.587092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/users/77aed16721a7465ab3ea6f8255da3959 => generated 247 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:02.595212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.711588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf546b-a663-4ec7-b366-7957de9512b4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.749959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.750646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.750934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.751207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.752384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.754241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:02.756261 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:02.757105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:02.773521 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.834789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:02.919477 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa3d9-72c0-47ab-a52d-291e415d5630 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:02.981825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:02.982601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:02.982885 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:02.983162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:02.983879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:02.984185 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:02.985571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.000528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1965-4351-4aab-920e-fb0263daeb0e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.009344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:03.010200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.073485 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.074094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.074406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.074683 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.154661 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.154661 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.182933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.209183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f191d0-2b35-4b44-8b35-31c729aabd9f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.224812 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.267050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 89/173] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:03.267741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.274208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce5a1-2916-419b-9e58-0080a370b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.274999 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce5a1-2916-419b-9e58-0080a370b062 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.275281 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce5a1-2916-419b-9e58-0080a370b062 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.275555 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce5a1-2916-419b-9e58-0080a370b062 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f/users/91f2c0f45e21432b90f00d30537cc1c7/roles/b233f3c68dc749d1808da33222469071` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.280730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce5a1-2916-419b-9e58-0080a370b062 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1754e4951234624ac0ae407c871458f, user_id=91f2c0f45e21432b90f00d30537cc1c7, role_id=b233f3c68dc749d1808da33222469071)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.282993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce5a1-2916-419b-9e58-0080a370b062 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.351864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 85/174] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:03 2022] PUT /identity/v3/projects/a1754e4951234624ac0ae407c871458f/users/91f2c0f45e21432b90f00d30537cc1c7/roles/b233f3c68dc749d1808da33222469071 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:03.353636 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd5d2-7395-4787-ab59-85662004ed46 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.354143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd5d2-7395-4787-ab59-85662004ed46 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.354714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd5d2-7395-4787-ab59-85662004ed46 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.357240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 86/175] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:03.358344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd5d2-7395-4787-ab59-85662004ed46 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.401182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbfb0b-50fc-41b4-8f2c-9ceef53f3f11 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.433964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.444918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127dccf-30d9-4118-aaf4-c4c763abcfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.445913 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dccf-30d9-4118-aaf4-c4c763abcfb5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.446434 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dccf-30d9-4118-aaf4-c4c763abcfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.446926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dccf-30d9-4118-aaf4-c4c763abcfb5 None admin] PATH_INFO: `/v3/users/466bf745aeca4805912f77525bf77d11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.448797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127dccf-30d9-4118-aaf4-c4c763abcfb5 None admin] RBAC: Authorizing `identity:get_user(user_id=466bf745aeca4805912f77525bf77d11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.450830 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127dccf-30d9-4118-aaf4-c4c763abcfb5 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.453615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 90/176] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/users/466bf745aeca4805912f77525bf77d11 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:03.459602 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.460493 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.460977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.495287 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:03.498901 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:03.515638 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd5d2-7395-4787-ab59-85662004ed46 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.576962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.578093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.578818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.579307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.581669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.583414 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.586321 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 87/177] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:03.587415 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.640439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.681355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 91/178] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:03.681355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.731033 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6105-0a8a-43d8-a298-7e022debb41f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.786685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a013852-5e24-419b-9d7c-960bddf0a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.787691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013852-5e24-419b-9d7c-960bddf0a5a5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.788292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013852-5e24-419b-9d7c-960bddf0a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.788765 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013852-5e24-419b-9d7c-960bddf0a5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.795267 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96064-705e-45a2-a60b-1d4786ca739a None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:03.823876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.837526 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:03.839262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:03.839262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:03.839262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:03.839805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=77aed16721a7465ab3ea6f8255da3959) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:03.840077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.841858 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.849372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 92/179] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/role_assignments?user.id=77aed16721a7465ab3ea6f8255da3959&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=b808049b0af24ba79f7b5a53a732242d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:03.850140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:03.873732 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a013852-5e24-419b-9d7c-960bddf0a5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:03.875768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a013852-5e24-419b-9d7c-960bddf0a5a5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:03.916546 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.976027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c5ab-1d6a-471f-9681-0956b407ece3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.028029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 88/180] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:04.036005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ef4e-21fa-4191-bb68-9cdf3f1b1f6e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.036305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ef4e-21fa-4191-bb68-9cdf3f1b1f6e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.036561 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ef4e-21fa-4191-bb68-9cdf3f1b1f6e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.037998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 89/181] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:04.038792 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ef4e-21fa-4191-bb68-9cdf3f1b1f6e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.039898 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623064-c54e-42b6-b985-34bf480d5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.040568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623064-c54e-42b6-b985-34bf480d5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.040844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623064-c54e-42b6-b985-34bf480d5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.041115 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623064-c54e-42b6-b985-34bf480d5ea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.062030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623064-c54e-42b6-b985-34bf480d5ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-d8623064-c54e-42b6-b985-34bf480d5ea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:04.069329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:04.070307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:04.071564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 93/182] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:04.072417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.073112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.073112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.112668 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:04.114120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:04.173295 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.208728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ef4e-21fa-4191-bb68-9cdf3f1b1f6e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.208913 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 94/183] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:04.208913 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.247533 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d337d95-de20-43df-a1eb-6bcb6009e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.248778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d337d95-de20-43df-a1eb-6bcb6009e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.249058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d337d95-de20-43df-a1eb-6bcb6009e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.249328 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d337d95-de20-43df-a1eb-6bcb6009e4c6 None admin] PATH_INFO: `/v3/projects/d8595b2efe954cde80da195ed845ca5f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.252067 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d337d95-de20-43df-a1eb-6bcb6009e4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d8595b2efe954cde80da195ed845ca5f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.252186 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d337d95-de20-43df-a1eb-6bcb6009e4c6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.254022 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 90/184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/projects/d8595b2efe954cde80da195ed845ca5f => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:04.255348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206896e-c568-4ea8-998a-51ddc57275b5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.255741 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206896e-c568-4ea8-998a-51ddc57275b5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.256024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206896e-c568-4ea8-998a-51ddc57275b5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.257246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 91/185] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:04.262052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206896e-c568-4ea8-998a-51ddc57275b5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.265691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.320152 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c28ce5-0bfe-47a6-bca4-8fcf88bb1c58 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.358070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.359010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.359299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.359737 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.360785 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:04.361135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.362500 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ace889-20a7-458d-af69-0f23031d6fd2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.369930 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206896e-c568-4ea8-998a-51ddc57275b5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.372148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 95/186] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:04.373861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.374151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.374455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.393083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:04.394274 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:04.411811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.412445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.412723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.412994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.413817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=d8595b2efe954cde80da195ed845ca5f, user.id=466bf745aeca4805912f77525bf77d11) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:04.414096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.415574 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.421492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 92/187] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/role_assignments?user.id=466bf745aeca4805912f77525bf77d11&scope.project.id=d8595b2efe954cde80da195ed845ca5f&role.id=def5a58760984080ab8717cb294b3f64 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:04.422299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.434174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.475374 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 96/188] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:04.476780 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.527289 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.578883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228583f-35fb-420d-86dc-1903c1ce066f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.605833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210ebb-0187-4a00-937a-63f89ba695be None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.631081 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.631767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.632017 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.632292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.633451 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.634937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.636688 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:04.637286 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.658980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.659629 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.660954 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.661239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] PATH_INFO: `/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.680037 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] RBAC: Authorizing `identity:get_user(user_id=cb946d29ef5e4c78b6be8a3094fb98d9)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.682683 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.683615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 97/190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:04.684540 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.716698 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.765564 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743eda4-b771-45b9-82f4-43fc9ddac1ae None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.790973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7c2b0-b49c-4a3c-91bd-355911e2db66 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.804030 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.804677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.804958 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.805234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.807473 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:04.816599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:04.821560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:04.822508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:04.823290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 94/191] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:04.823950 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.832717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.833355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.833632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.833907 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:04.834638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:04.836126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:04.918748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 98/192] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:04 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:04.920127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:04.928558 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979896-6ff8-464d-9475-816e70500465 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:04.971558 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:04.972121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:04.972641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:04.972816 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.047916 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.056210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.057771 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.076935 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.093372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d148c-b543-48d0-af87-23945f5beaff None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.145355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.146457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.146987 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.147870 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.148113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:05.148423 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.149940 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.166377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 99/193] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:05.168391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.205747 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 95/194] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:05.212756 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.301827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b6ada-39a7-4555-b6ef-2263ec4d7365 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.345107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.352001 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.352667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.352952 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.353228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] PATH_INFO: `/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.354475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] RBAC: Authorizing `identity:get_user(user_id=cb946d29ef5e4c78b6be8a3094fb98d9)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.354830 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12986385-1ed1-4d59-9dd2-937cd6fce179 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.355951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.362378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 100/195] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:05.364195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.384644 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.414855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.415528 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.415810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.416087 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.423118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.424589 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.432865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 96/196] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:05.432865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.536192 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42486db-b918-4bdc-bbe5-a7137b8c5fff None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.603116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.603760 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.604044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.604322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.624612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f903c-5130-46d9-a160-bc005ecb3eef None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:05.701396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:05.702041 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:05.702345 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:05.702623 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:05.703587 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=cb946d29ef5e4c78b6be8a3094fb98d9) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:05.703901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.705359 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.719759 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 97/197] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/role_assignments?user.id=cb946d29ef5e4c78b6be8a3094fb98d9&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=b808049b0af24ba79f7b5a53a732242d => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:05.751584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:05.753105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:05.794801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:05.916993 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 101/198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:05.922171 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:05.958212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:06.052990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04091d2-6b01-408b-bdbc-ac9ee7ff30ad None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.103003 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d165cf-3c79-4e07-9731-e0dda08f9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.103668 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d165cf-3c79-4e07-9731-e0dda08f9d8a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.103954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d165cf-3c79-4e07-9731-e0dda08f9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.104240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d165cf-3c79-4e07-9731-e0dda08f9d8a None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.105473 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d165cf-3c79-4e07-9731-e0dda08f9d8a None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.107475 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d165cf-3c79-4e07-9731-e0dda08f9d8a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.109281 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 98/199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:05 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:06.115194 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.357996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c2cd2-8c99-4fc7-b091-2f69aabc0923 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.380314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:06.393603 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.394233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.394544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.394824 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.395618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] RBAC: Adding query filter params (role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=cb946d29ef5e4c78b6be8a3094fb98d9) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:06.395930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.397373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe333ec6-33da-499a-bf54-cf4a811b7301 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.403347 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 102/200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:06 2022] GET /identity/v3/role_assignments?user.id=cb946d29ef5e4c78b6be8a3094fb98d9&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=75ed1976f12e48b38908f23e51856c1e => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:06.441250 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626ae8-0ec3-4b64-9d6c-fc9d78f13da5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.441556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626ae8-0ec3-4b64-9d6c-fc9d78f13da5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.441807 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626ae8-0ec3-4b64-9d6c-fc9d78f13da5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.443209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 99/201] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:06.448916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.449206 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.449491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.468828 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:06.470039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:06.551403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 103/202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:06.576964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23626ae8-0ec3-4b64-9d6c-fc9d78f13da5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.711202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:06.728106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23626ae8-0ec3-4b64-9d6c-fc9d78f13da5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.775761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.776837 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.777584 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.778077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.795626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:06.801121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:06.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:06.802905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:06.805309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 100/203] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:06.815381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:06.921512 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91694fc0-990e-4393-be88-73ec6fc03e25 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:06.931223 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:06.957448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:06.958078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:06.958388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:06.958663 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:06.959384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:06.959747 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:06.961119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:06.969950 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 104/204] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:06.975491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:07.136446 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b273-6e5c-4bb7-9ef2-6fe033a8c753 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:07.189388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:07.190052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.190360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.190644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] PATH_INFO: `/v3/users/91f2c0f45e21432b90f00d30537cc1c7` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.191855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] RBAC: Authorizing `identity:get_user(user_id=91f2c0f45e21432b90f00d30537cc1c7)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:07.193311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:07.195264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 101/205] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:06 2022] GET /identity/v3/users/91f2c0f45e21432b90f00d30537cc1c7 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:07.200453 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:07.337311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120d32-dfaa-46cf-af76-75f66610b072 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:07.378355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:07.378355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.378355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.378355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.436469 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:07.468673 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:07.470155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:07.586308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 105/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:07.592143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:07.618415 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:07.736556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8e06-bba7-41bf-a785-0413e07392fe None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:07.788915 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c379065-e3d8-4ae6-86d0-ab0645b8ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:07.789570 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379065-e3d8-4ae6-86d0-ab0645b8ef99 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.789852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379065-e3d8-4ae6-86d0-ab0645b8ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.790130 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379065-e3d8-4ae6-86d0-ab0645b8ef99 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.791360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c379065-e3d8-4ae6-86d0-ab0645b8ef99 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:07.792793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c379065-e3d8-4ae6-86d0-ab0645b8ef99 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:07.795337 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 102/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:07 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:07.801479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:07.864464 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81f8d-19e5-4b05-b9ce-c7dff7491b39 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.864645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81f8d-19e5-4b05-b9ce-c7dff7491b39 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.864942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81f8d-19e5-4b05-b9ce-c7dff7491b39 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.866356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 103/208] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:02:07.873571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f1ef-42b6-4b9d-9bba-1b050ee70cad None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.873877 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f1ef-42b6-4b9d-9bba-1b050ee70cad None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.874252 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f1ef-42b6-4b9d-9bba-1b050ee70cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.883121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:07.911387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67845bb-54a0-4bcb-a0c4-8db4eb1c1ca3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:07.923328 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1bf0f1ef-42b6-4b9d-9bba-1b050ee70cad None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:07.924671 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1bf0f1ef-42b6-4b9d-9bba-1b050ee70cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:07.948630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:07.949273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:07.949560 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:07.949835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:07.950737 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] RBAC: Adding query filter params (role.id=b233f3c68dc749d1808da33222469071, scope.project.id=a1754e4951234624ac0ae407c871458f, user.id=91f2c0f45e21432b90f00d30537cc1c7) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:07.951523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:07.952989 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:07.959562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 106/209] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:07 2022] GET /identity/v3/role_assignments?user.id=91f2c0f45e21432b90f00d30537cc1c7&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=b233f3c68dc749d1808da33222469071 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:08.077247 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 104/210] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:08.114085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.250706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609acb94-bc03-4767-8217-7de3b616fccb None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.292770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef983cb0-7b6a-48b4-933d-f382f36967d9 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.293392 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef983cb0-7b6a-48b4-933d-f382f36967d9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.293871 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef983cb0-7b6a-48b4-933d-f382f36967d9 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.295791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.296450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.296835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.297004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.297186 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 105/211] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:08.302641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.302925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.303201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.303445 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:08.318889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:08.323997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:08.324866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:08.327973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:08.328770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:08.329365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:08.330557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 107/212] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:08.336754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.347156 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:08.422527 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:08.453700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.467994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a948-8b51-4d63-93c2-61a38b4fa39a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.511337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.511885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.512163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.512436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.513690 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:08.514042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:08.515819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:08.525198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 108/214] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:08.533058 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.582161 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c319e-2697-495a-9928-80c28123cf57 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.605872 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:08.621299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85775d2-88bd-49e9-8ff9-07f34e016752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.623736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85775d2-88bd-49e9-8ff9-07f34e016752 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.624027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85775d2-88bd-49e9-8ff9-07f34e016752 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.624309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85775d2-88bd-49e9-8ff9-07f34e016752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.625532 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85775d2-88bd-49e9-8ff9-07f34e016752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:08.627030 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85775d2-88bd-49e9-8ff9-07f34e016752 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:08.628780 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 107/215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:08.633274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee93497-f1c6-4952-abb5-1493f3740ac9 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.633274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee93497-f1c6-4952-abb5-1493f3740ac9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.633274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee93497-f1c6-4952-abb5-1493f3740ac9 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.633274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 108/216] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:08.634107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee93497-f1c6-4952-abb5-1493f3740ac9 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.659255 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badffc3b-a66d-415a-8f68-e7304a872293 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.659891 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:08.697327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2903d-c49f-4243-b8dc-718856d70fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.697986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2903d-c49f-4243-b8dc-718856d70fde None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.698270 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2903d-c49f-4243-b8dc-718856d70fde None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.698576 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2903d-c49f-4243-b8dc-718856d70fde None admin] PATH_INFO: `/v3/users/fdf1de97482046a39294a8b0ffbcbb57` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.713233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2903d-c49f-4243-b8dc-718856d70fde None admin] RBAC: Authorizing `identity:get_user(user_id=fdf1de97482046a39294a8b0ffbcbb57)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:08.715473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2903d-c49f-4243-b8dc-718856d70fde None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:08.717948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 109/217] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/users/fdf1de97482046a39294a8b0ffbcbb57 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:08.722495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.722495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.722495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.739722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:08.740962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:08.746013 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee93497-f1c6-4952-abb5-1493f3740ac9 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.784136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.784707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.784990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.785265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:08.785957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:08.787438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:08.813249 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:08.814421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.862948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:08.917323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49723bc-0871-44b0-9663-d354d8e2c691 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:08.922697 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 109/219] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:08 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:08.923866 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:08.968667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0ab9e-b49a-430d-96c2-3f3e3ad7c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:08.969315 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0ab9e-b49a-430d-96c2-3f3e3ad7c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:08.969604 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0ab9e-b49a-430d-96c2-3f3e3ad7c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:08.969975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0ab9e-b49a-430d-96c2-3f3e3ad7c9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.051751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.057380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0ab9e-b49a-430d-96c2-3f3e3ad7c9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.059283 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0ab9e-b49a-430d-96c2-3f3e3ad7c9a9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.082336 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a8e6-0af0-4a81-8b2c-cf2db55d4a38 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.119917 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.130784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b788338-386b-453f-8186-2938e25f140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.130962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b788338-386b-453f-8186-2938e25f140f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.131116 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b788338-386b-453f-8186-2938e25f140f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.131386 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b788338-386b-453f-8186-2938e25f140f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.146201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b788338-386b-453f-8186-2938e25f140f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8b788338-386b-453f-8186-2938e25f140f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:09.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:09.155630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 110/220] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:09.156440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b8485-5f7b-4141-9327-223a4695a913 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.157178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b8485-5f7b-4141-9327-223a4695a913 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.157178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b8485-5f7b-4141-9327-223a4695a913 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.157306 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 111/221] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:09.160690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b8485-5f7b-4141-9327-223a4695a913 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.226962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 111/222] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:09.227987 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.228280 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.228556 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.250701 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:09.251897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:09.323820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b8485-5f7b-4141-9327-223a4695a913 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.335498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 112/223] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:09.336832 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.381495 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.382122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.382434 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.382707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.383425 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:09.383729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.385101 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.386655 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.396077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 112/224] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:09.397123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.424539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.451314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf98fd-74c8-4314-9307-85e70484e00f None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.489237 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.489889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.490168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.490473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.491627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.493060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.494965 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:09.495867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.508233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1266e-5350-4881-a26b-f47e58e5825d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.546507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.547164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.547445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.547718 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.559395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:09.565643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:09.566563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:09.567347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 113/226] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:09.567994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.610931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472eb6-bc1f-4e27-94ca-67464e7804f9 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.632398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.649683 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.650364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.650647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.650923 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] PATH_INFO: `/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.652349 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] RBAC: Authorizing `identity:get_user(user_id=cb946d29ef5e4c78b6be8a3094fb98d9)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.653926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.656323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 114/227] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:09.657090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.669535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.684468 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b8c5d-90b5-4b56-ba7a-ffa5ca36e08b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.722884 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.723838 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.724454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.725005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.725973 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=fdf1de97482046a39294a8b0ffbcbb57) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:09.726485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.728192 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.734466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 114/228] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/role_assignments?user.id=fdf1de97482046a39294a8b0ffbcbb57&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=def5a58760984080ab8717cb294b3f64 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:09.735617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.769313 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79872098-9a83-485e-bbe5-481a4eb2ed3b None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.807276 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.807921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.808218 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.808708 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.809219 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:09.809525 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.812075 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.821402 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 115/229] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:09.828569 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.853380 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e0076-afeb-4935-a631-a601a796b063 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:09.877509 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:09.894700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:09.895783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:09.896270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:09.896837 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:09.904366 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:09.906636 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:09.908730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 115/230] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:09.921037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:09.991388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:10.058832 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc527825-31ca-4b90-a88d-da35021028b4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:10.061237 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f265f-9340-4c38-af90-ca7dfeb99f30 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:10.101354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:10.102019 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.102349 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.102645 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] PATH_INFO: `/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.104125 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] RBAC: Authorizing `identity:get_user(user_id=cb946d29ef5e4c78b6be8a3094fb98d9)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:10.105614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:10.108788 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 116/231] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:09 2022] GET /identity/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:10.113858 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:10.141474 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:10.142079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.142385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.142667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/cb946d29ef5e4c78b6be8a3094fb98d9/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.148987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] RBAC: Authorizing `identity:create_grant(project_id=153dbedcd8164a2ea26cebf124ccb842, user_id=cb946d29ef5e4c78b6be8a3094fb98d9, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:10.153209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:10.248787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a40805-239a-4522-8bc1-59bb3dfe868c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:10.276471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 116/232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:09 2022] PUT /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/cb946d29ef5e4c78b6be8a3094fb98d9/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:10.287021 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb24abe-3bf0-4559-9b02-09111d6d99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:10.288170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24abe-3bf0-4559-9b02-09111d6d99bd None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.288639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24abe-3bf0-4559-9b02-09111d6d99bd None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.289258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24abe-3bf0-4559-9b02-09111d6d99bd None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.291020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb24abe-3bf0-4559-9b02-09111d6d99bd None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:10.292781 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb24abe-3bf0-4559-9b02-09111d6d99bd None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:10.295811 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 117/233] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:10 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:10.301489 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:10.393522 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:10.470453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a981a3-ce91-4a29-a89d-f9a106fc8947 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:10.513369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0314d53-6c2e-4e84-957b-74c5c33f4c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:10.514090 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314d53-6c2e-4e84-957b-74c5c33f4c9b None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:10.514411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314d53-6c2e-4e84-957b-74c5c33f4c9b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:10.515241 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314d53-6c2e-4e84-957b-74c5c33f4c9b None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/cb946d29ef5e4c78b6be8a3094fb98d9/roles/75ed1976f12e48b38908f23e51856c1e` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:10.518341 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0314d53-6c2e-4e84-957b-74c5c33f4c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=153dbedcd8164a2ea26cebf124ccb842, user_id=cb946d29ef5e4c78b6be8a3094fb98d9, role_id=75ed1976f12e48b38908f23e51856c1e)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:10.519788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0314d53-6c2e-4e84-957b-74c5c33f4c9b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:10.656875 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:10 2022] PUT /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/cb946d29ef5e4c78b6be8a3094fb98d9/roles/75ed1976f12e48b38908f23e51856c1e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:11.654129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98823-401e-4d19-a309-bacc2a74eceb None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:11.654721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98823-401e-4d19-a309-bacc2a74eceb None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:11.654721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98823-401e-4d19-a309-bacc2a74eceb None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:11.656462 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 118/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:11.661767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d846198-2799-4c1e-b84f-6fa142ea902d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:11.662642 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d846198-2799-4c1e-b84f-6fa142ea902d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:11.663126 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d846198-2799-4c1e-b84f-6fa142ea902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:11.682390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6d846198-2799-4c1e-b84f-6fa142ea902d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:11.683917 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6d846198-2799-4c1e-b84f-6fa142ea902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:11.773385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 118/236] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:11.803245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98823-401e-4d19-a309-bacc2a74eceb None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:11.815605 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:11.902736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f562fc-445c-4633-b951-97ebdf2259b1 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:11.902907 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f562fc-445c-4633-b951-97ebdf2259b1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:11.903189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f562fc-445c-4633-b951-97ebdf2259b1 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:11.905215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 119/237] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:11.910660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:11.910941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:11.911217 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:11.919083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98823-401e-4d19-a309-bacc2a74eceb None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:11.947311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:11.948500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:11.963649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:11.964298 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:11.964577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:11.964851 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:11.982563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:11.987877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:11.988798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:11.989631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 119/238] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:11.996016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.027848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:12.070681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:12.102505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 120/239] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:12.119368 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ee50c-2457-48f5-8b1c-24059c09d35e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:12.128879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.250864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:12.251503 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.251787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.252065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.252797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:12.253113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:12.262900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:12.286023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:12.292159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.319209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107ea9-3ba4-4ff7-8186-38a1c1d0a48c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:12.364536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e5a3a-011d-42ae-8051-3f531937b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:12.365540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5a3a-011d-42ae-8051-3f531937b48a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.366021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5a3a-011d-42ae-8051-3f531937b48a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.366518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5a3a-011d-42ae-8051-3f531937b48a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.369133 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e5a3a-011d-42ae-8051-3f531937b48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:12.371036 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e5a3a-011d-42ae-8051-3f531937b48a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:12.375475 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:12.377168 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4130-bcb3-4532-9c27-41aa17c01ebb None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.378305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4130-bcb3-4532-9c27-41aa17c01ebb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.378305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4130-bcb3-4532-9c27-41aa17c01ebb None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.383095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 122/242] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:12.385215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.385529 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.385825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.406038 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:12.407580 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:12.433623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abde0b-38ea-4a8d-b362-d7aeb140796e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:12.439505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:12.469417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:12.475224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:12.475922 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.476205 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.476648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] PATH_INFO: `/v3/users/71cb0251cb914a3c99a62ab54c4bc770` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.484810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 123/243] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:12.486064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.491578 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] RBAC: Authorizing `identity:get_user(user_id=71cb0251cb914a3c99a62ab54c4bc770)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:12.493099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:12.495234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 121/244] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:12 2022] GET /identity/v3/users/71cb0251cb914a3c99a62ab54c4bc770 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:12.502002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.601595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939281b-862f-4e80-b76d-da3f5fbad0a6 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:12.606858 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2cb82-2d75-4918-beb4-609fcee97e16 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:12.649230 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:12.650138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.650683 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.651104 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.716759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:12.730226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:12.732231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:12.761983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:12.762705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.763657 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.764072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.764835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:12.766358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:12.837871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:12.843297 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.864270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 124/246] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:12 2022] POST /identity/v3/users => generated 293 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:12.870763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.931746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:13.036538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:13.060775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a419e-0d27-456d-8a2b-50a60a95eb2d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.079619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea3d80-3c85-4c8d-88c4-dcc50d409bde None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.109266 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.110275 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.110898 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.111181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.123505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4cf5f-45ce-494f-bf69-b549db0405ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.124261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4cf5f-45ce-494f-bf69-b549db0405ad None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.124543 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4cf5f-45ce-494f-bf69-b549db0405ad None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.124734 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:13.124835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4cf5f-45ce-494f-bf69-b549db0405ad None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.128061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4cf5f-45ce-494f-bf69-b549db0405ad None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:13.129531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4cf5f-45ce-494f-bf69-b549db0405ad None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:13.129739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:13.130620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:13.131406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:13.132008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:12 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:13.132075 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 123/248] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:13.132725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee477cc-9f05-4430-a912-70da2f7b3c56 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.133011 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee477cc-9f05-4430-a912-70da2f7b3c56 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.133283 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee477cc-9f05-4430-a912-70da2f7b3c56 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.134788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 126/249] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:13.136649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.138619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee477cc-9f05-4430-a912-70da2f7b3c56 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.255074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:13.268714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee477cc-9f05-4430-a912-70da2f7b3c56 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.272662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa9c9-06cc-42b5-aee2-8066720d4695 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.317891 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.319234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.319234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.319234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.321070 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] RBAC: Adding query filter params (role.id=b233f3c68dc749d1808da33222469071, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=71cb0251cb914a3c99a62ab54c4bc770) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:13.321070 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:13.321507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77a728-29b0-4edc-b088-23443d8d5a97 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:13.322808 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.323552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.323831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.324105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.324930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:13.325283 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:13.326957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:13.327996 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 127/250] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:13 2022] GET /identity/v3/role_assignments?user.id=71cb0251cb914a3c99a62ab54c4bc770&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=b233f3c68dc749d1808da33222469071 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:13.329545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.329670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.329865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.337700 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 124/251] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:13.344820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.362020 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:13.364041 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:13.364291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:13.460217 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 128/252] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:13.495277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135912b-47f4-4c78-9191-f5c4d866d2a5 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.518588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.555057 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.555730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.556012 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.556286 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] PATH_INFO: `/v3/users/fdf1de97482046a39294a8b0ffbcbb57` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.557589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf1de97482046a39294a8b0ffbcbb57)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:13.559069 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:13.561651 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 125/253] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:13 2022] GET /identity/v3/users/fdf1de97482046a39294a8b0ffbcbb57 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:13.567048 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.718454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:13.744185 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2b14-0a89-415d-9ed6-e624a8366121 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.758645 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:13.782831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.784698 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.785488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.785909 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.798458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:13.804164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:13.805266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:13.806209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:13.808622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 129/254] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:13.814321 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.832254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c71097-8d29-451e-8dee-5fc18ffbc140 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:13.885016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e50d4-c9ab-46ea-9fc0-82152da2ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:13.885589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e50d4-c9ab-46ea-9fc0-82152da2ed69 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.885865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e50d4-c9ab-46ea-9fc0-82152da2ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.886137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e50d4-c9ab-46ea-9fc0-82152da2ed69 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.888758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e50d4-c9ab-46ea-9fc0-82152da2ed69 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:13.890206 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e50d4-c9ab-46ea-9fc0-82152da2ed69 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:13.892102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 126/255] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:13 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:13.897808 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5d44-e8e0-4319-8c2a-d5f1b3933ecf None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:13.898097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5d44-e8e0-4319-8c2a-d5f1b3933ecf None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:13.898401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e5d44-e8e0-4319-8c2a-d5f1b3933ecf None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:13.899783 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 127/256] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:13.906887 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e5d44-e8e0-4319-8c2a-d5f1b3933ecf None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:13.993108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647773ce-addb-4649-b71f-1512a78e33b1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.062879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.063511 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.063793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.064063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.064782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:14.065082 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:14.066499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3d44-2e79-4166-bb07-3cacaa827275 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:14.068416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e5d44-e8e0-4319-8c2a-d5f1b3933ecf None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.087209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 130/257] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:14.090361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.090654 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.091438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.122845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:14.125879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.126601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.126891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.127166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/fdf1de97482046a39294a8b0ffbcbb57/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.127876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:14.129093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:14.129195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=153dbedcd8164a2ea26cebf124ccb842, user_id=fdf1de97482046a39294a8b0ffbcbb57, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:14.130596 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:14.192801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 128/258] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:13 2022] PUT /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/fdf1de97482046a39294a8b0ffbcbb57/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:14.193688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.218592 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:14.238677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 131/259] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:14.282235 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.380261 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e688b6-2c69-4473-a453-859026c03fb2 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.426309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.426309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.426309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.426309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] PATH_INFO: `/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.426682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] RBAC: Authorizing `identity:get_user(user_id=cb946d29ef5e4c78b6be8a3094fb98d9)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:14.427200 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:14.429328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 129/260] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:14.437135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.471542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3ed83-f7d5-4510-a145-f784a8ade8dc None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.535778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.536856 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.537371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.537836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:14.539143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.551448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:14.558237 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:14.564397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:14.565311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:14.566109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:14.568945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 132/261] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:14.576548 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.589481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5633070-76f7-4d86-828c-2ffb209bfd81 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.639478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.640117 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.640403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.640677 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.762437 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:14.763918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:14.792398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c7c6a-9260-42b9-9bf2-84573e55a7b6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:14.856057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:14.857202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:14.859121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:14.859121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:14.859121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:14.859503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:14.861092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:14.876923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 133/262] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:14.886029 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:14.889516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.918395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 130/263] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:14.930432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:14.986781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:15.041504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c05c-8d6b-4ccb-a61d-c2e5a3f2f0ab None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:15.083253 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:15.083917 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:15.084201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:15.084481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] PATH_INFO: `/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:15.086766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] RBAC: Authorizing `identity:get_user(user_id=cb946d29ef5e4c78b6be8a3094fb98d9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:15.088279 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:15.099151 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 134/264] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/users/cb946d29ef5e4c78b6be8a3094fb98d9 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:15.103619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:15.151233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f392652-2b46-473b-8bd0-b06e1eafca7c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:15.194078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:15.194827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:15.195112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:15.195391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:15.196566 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:15.198023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:15.200165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 131/265] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:14 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:15.206251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:15.292744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:15.310227 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfcecc-bcf7-45f5-9159-c6f90ba37faf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:15.361266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:15.383122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:15.383760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:15.384044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:15.384323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:15.420803 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f65903-96da-4052-a62c-ddbbaf281aa3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:15.475998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:15.476626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:15.476962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:15.477243 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:15.478037 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=cb946d29ef5e4c78b6be8a3094fb98d9) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:15.478367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:15.479931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:15.490312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 132/266] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:15 2022] GET /identity/v3/role_assignments?user.id=cb946d29ef5e4c78b6be8a3094fb98d9&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=b808049b0af24ba79f7b5a53a732242d => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:15.501602 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:15.503292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:15.647123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 135/267] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:15.653186 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:15.802823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938d7a-c840-4faf-8318-06f1addf3a17 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:15.811899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:15.841461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1106e-7b20-4dc5-bb15-bd77742ae35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:15.842612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1106e-7b20-4dc5-bb15-bd77742ae35f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:15.843102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1106e-7b20-4dc5-bb15-bd77742ae35f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:15.843600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1106e-7b20-4dc5-bb15-bd77742ae35f None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:15.844990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1106e-7b20-4dc5-bb15-bd77742ae35f None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:15.846652 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1106e-7b20-4dc5-bb15-bd77742ae35f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:15.848884 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 133/268] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:15 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:15.855248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:15.896893 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:15.993253 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa272dd2-f311-448b-9c76-bba2f9583ff1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:16.036723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:16.037362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.037639 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.037904 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.038745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] RBAC: Adding query filter params (role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=cb946d29ef5e4c78b6be8a3094fb98d9) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:16.039057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:16.040505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66269a-882d-4dee-8b7e-21d22c8445bb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:16.047709 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 136/269] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:15 2022] GET /identity/v3/role_assignments?user.id=cb946d29ef5e4c78b6be8a3094fb98d9&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=75ed1976f12e48b38908f23e51856c1e => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:16.260173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548c4b-7ce1-475d-a542-4618b0cb696e None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.260711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548c4b-7ce1-475d-a542-4618b0cb696e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.261197 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548c4b-7ce1-475d-a542-4618b0cb696e None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.263558 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 134/270] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:16.269982 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb21d-0db2-4073-89bc-4989a5064ff2 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.270400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb21d-0db2-4073-89bc-4989a5064ff2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.270573 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb21d-0db2-4073-89bc-4989a5064ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.291693 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-78dbb21d-0db2-4073-89bc-4989a5064ff2 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:16.293145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-78dbb21d-0db2-4073-89bc-4989a5064ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:16.376881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 137/271] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:16.402758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548c4b-7ce1-475d-a542-4618b0cb696e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:16.472136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c246c8-9146-44f3-970d-f3fa7c18693a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.472483 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c246c8-9146-44f3-970d-f3fa7c18693a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.472724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c246c8-9146-44f3-970d-f3fa7c18693a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.474223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 138/272] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:02:16.479842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805381a-5868-417b-81d4-9ec244e9b3c5 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.479842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805381a-5868-417b-81d4-9ec244e9b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.479842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805381a-5868-417b-81d4-9ec244e9b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.507678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6805381a-5868-417b-81d4-9ec244e9b3c5 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:16.508913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6805381a-5868-417b-81d4-9ec244e9b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:16.532320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:16.535941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548c4b-7ce1-475d-a542-4618b0cb696e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:16.580064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286632c-4f1c-4585-9bc4-80a025abb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:16.580851 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286632c-4f1c-4585-9bc4-80a025abb770 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.581153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286632c-4f1c-4585-9bc4-80a025abb770 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.581431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286632c-4f1c-4585-9bc4-80a025abb770 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.583166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286632c-4f1c-4585-9bc4-80a025abb770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:16.586564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286632c-4f1c-4585-9bc4-80a025abb770 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:16.587903 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 135/273] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:16.589885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ec59-94a7-45be-a3e2-a7342939f8ae None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.589885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ec59-94a7-45be-a3e2-a7342939f8ae None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.589885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ec59-94a7-45be-a3e2-a7342939f8ae None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.590263 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 136/274] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:16.595832 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ec59-94a7-45be-a3e2-a7342939f8ae None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:16.599999 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 139/275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:16.601193 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.601487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.601765 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.619488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:16.621193 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:16.644610 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:16.692443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:16.693139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:16.710483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ec59-94a7-45be-a3e2-a7342939f8ae None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:16.749217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:16.749839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.750130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.750433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.751122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:16.752569 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:16.783171 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:16.801914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aafca-ae43-4229-8f6a-ea8e12b9f7fc None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:16.836230 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:16.836867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:16.837148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:16.837420 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:16.848329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 137/277] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:16 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:16.857188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:16.858210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:16.859068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 141/278] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:16.859820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:16.861123 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.012185 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b330771-b67f-492e-829d-024141ed2bfd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.016179 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.025443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdba84-27b8-4753-99b6-26e631147add None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.054925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.055500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.055784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.056062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.068991 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.069626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.069934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.070209 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.070946 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.071074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:17.071364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.072089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:17.072636 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:17.078172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:17.079194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:17.080390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:17.080993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 142/279] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:17.086368 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.088911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 138/280] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:17.095361 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.219010 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b681-a4df-44c4-9ba2-1aef9ddb97a6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.236566 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55892d7-5cb6-43c2-95db-00765ec8f957 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.266832 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.267818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.268161 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.268503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.269289 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:17.269749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.271202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.277106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.278053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.278053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.278992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] PATH_INFO: `/v3/users/e60a3ddc4101418c9b8bb8c1f30ddd11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.283622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 143/281] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:17.293914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.299217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] RBAC: Authorizing `identity:get_user(user_id=e60a3ddc4101418c9b8bb8c1f30ddd11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.300875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.303032 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 139/282] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/users/e60a3ddc4101418c9b8bb8c1f30ddd11 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:17.311573 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.343129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.386642 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.439311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff23d6-097d-4b41-b5f1-b6fc773f200c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.445279 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b864-c3c7-4b67-b043-e201ffe8e9cc None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.478644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.479650 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.480298 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.480776 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] PATH_INFO: `/v3/users/71cb0251cb914a3c99a62ab54c4bc770` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.482932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] RBAC: Authorizing `identity:get_user(user_id=71cb0251cb914a3c99a62ab54c4bc770)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.485057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.487425 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 144/283] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/users/71cb0251cb914a3c99a62ab54c4bc770 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:17.495468 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.524374 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.525201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.525783 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.526133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.527303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, user.id=e60a3ddc4101418c9b8bb8c1f30ddd11, scope.system=all) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:17.527901 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.530433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b6c47-b7fc-47e3-a3f4-0991dca0b6eb None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.538014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 140/284] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/role_assignments?user.id=e60a3ddc4101418c9b8bb8c1f30ddd11&scope.system=all&role.id=def5a58760984080ab8717cb294b3f64 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:17.543744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dca2a-da4e-4c3c-9b6d-fd00dc956b69 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.544868 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dca2a-da4e-4c3c-9b6d-fd00dc956b69 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.545383 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dca2a-da4e-4c3c-9b6d-fd00dc956b69 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.551900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 141/285] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:17.561175 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.561862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.562400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.599852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:17.601081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:17.646176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfd18-0339-4625-ae8c-f29db9af5e6f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.699245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.709330 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.710123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.710497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.710838 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.721478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.721478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.721478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 145/286] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:17.722625 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.756490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 142/287] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:17.802493 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:17.828105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:17.895268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e307-43c7-4e77-9519-2ccac5884776 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:17.960735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:17.961423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:17.961709 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:17.961986 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/71cb0251cb914a3c99a62ab54c4bc770/roles/b233f3c68dc749d1808da33222469071` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:17.967644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=153dbedcd8164a2ea26cebf124ccb842, user_id=71cb0251cb914a3c99a62ab54c4bc770, role_id=b233f3c68dc749d1808da33222469071)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:17.969108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:17.985382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cfa16-d969-4677-b234-f8b7ebef592e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.021981 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.022678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.022963 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.023247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.035633 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:18.041980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:18.042854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:18.043725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 143/288] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:18.048879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.118395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 146/289] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:17 2022] PUT /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842/users/71cb0251cb914a3c99a62ab54c4bc770/roles/b233f3c68dc749d1808da33222469071 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:18.128604 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:18.161773 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01697-6129-458e-ac44-049c30c39789 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.199219 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.199969 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.200705 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.200981 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.201710 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:18.202011 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.203481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.213020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:18.222940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.318194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:18.371699 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8e1e-26ae-4667-b61a-32d08974f1e0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.412044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.412708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.412994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.413273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] PATH_INFO: `/v3/users/fdf1de97482046a39294a8b0ffbcbb57` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.414507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] RBAC: Authorizing `identity:get_user(user_id=fdf1de97482046a39294a8b0ffbcbb57)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.415957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.417862 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 147/291] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/users/fdf1de97482046a39294a8b0ffbcbb57 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:18.424245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.533073 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111fb7f-ce49-424c-b1cc-0e704562da57 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.581388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.582023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.582327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.582612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.588350 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:18.674522 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.675898 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.791686 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:18.797384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:18.929019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd9a85-6bc5-490f-b9c0-db5a84f1fbad None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:18.969976 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:18.978704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d7b66-4386-4496-aaf2-894a8a5bf862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:18.983071 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7b66-4386-4496-aaf2-894a8a5bf862 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:18.983360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7b66-4386-4496-aaf2-894a8a5bf862 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:18.983654 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7b66-4386-4496-aaf2-894a8a5bf862 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:18.984881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d7b66-4386-4496-aaf2-894a8a5bf862 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:18.986362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d7b66-4386-4496-aaf2-894a8a5bf862 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:18.989883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 148/293] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:18.993856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.038599 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:19.107374 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c4ab5-3d51-417b-a1ce-7c5973aefff6 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.155797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.156426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.156710 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.156991 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.157786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=fdf1de97482046a39294a8b0ffbcbb57) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:19.158099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:19.159561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d78c9-a597-42f3-9750-0f8b38353070 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:19.171354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 146/294] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:18 2022] GET /identity/v3/role_assignments?user.id=fdf1de97482046a39294a8b0ffbcbb57&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=def5a58760984080ab8717cb294b3f64 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:19.673190 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7743-f175-40a0-a5ec-fc556a403d48 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.673516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7743-f175-40a0-a5ec-fc556a403d48 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.673760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7743-f175-40a0-a5ec-fc556a403d48 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.675405 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 149/295] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:19.685337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630921-87b5-4372-9396-8319a6c379c1 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.686015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630921-87b5-4372-9396-8319a6c379c1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.686539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630921-87b5-4372-9396-8319a6c379c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.710261 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-7c630921-87b5-4372-9396-8319a6c379c1 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:19.711481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-7c630921-87b5-4372-9396-8319a6c379c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:19.808889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:19.835722 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7743-f175-40a0-a5ec-fc556a403d48 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:19.946117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7743-f175-40a0-a5ec-fc556a403d48 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:19.971737 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11278-b725-4055-b7ff-478f1a2586d8 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.972280 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11278-b725-4055-b7ff-478f1a2586d8 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.972564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11278-b725-4055-b7ff-478f1a2586d8 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.975320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 148/297] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:19.985989 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.986394 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.986596 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:19.995779 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:19.996445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:19.996727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:19.997556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.010538 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:20.011369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:20.012600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:20.018467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:20.019344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:20.020140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:20.022809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 150/298] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:20.029046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.041897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:20.094538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 149/299] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:20.114675 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:20.117470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.163673 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee2c1b-dc9c-41b7-83ff-6d945572e4b4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.247415 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.247960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.248244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.248519 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.249243 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:20.249550 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:20.250947 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b50e-d4b2-40ae-8126-35817a6f347b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.259383 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 151/300] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:20.260565 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c0748-51af-459a-97e1-f192255d9eed None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.260851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c0748-51af-459a-97e1-f192255d9eed None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.261129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c0748-51af-459a-97e1-f192255d9eed None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.262530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 152/301] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:20.267617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c0748-51af-459a-97e1-f192255d9eed None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.290584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac29c-8614-4c4c-bd42-f661498f6688 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.326254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c17d6-bdfb-4a57-baa0-a4b960be947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.326987 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c17d6-bdfb-4a57-baa0-a4b960be947e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.327271 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c17d6-bdfb-4a57-baa0-a4b960be947e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.327744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c17d6-bdfb-4a57-baa0-a4b960be947e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.328704 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c17d6-bdfb-4a57-baa0-a4b960be947e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:20.330143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c17d6-bdfb-4a57-baa0-a4b960be947e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.336483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 150/302] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:20.337552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.337837 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.338114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.355539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:20.357255 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:20.376818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c0748-51af-459a-97e1-f192255d9eed None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.380348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:20.394447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:20.413929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.414610 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.414897 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.415177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] PATH_INFO: `/v3/users/c07dcac0537a462497484facd373edea` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.438304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 151/303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:20.438518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] RBAC: Authorizing `identity:get_user(user_id=c07dcac0537a462497484facd373edea)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:20.438612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.438695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.438695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 153/304] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/users/c07dcac0537a462497484facd373edea => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:20.439799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.545665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677941-714f-490f-8fd6-f2beb9af5388 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.546862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ed15b-a08b-4d0c-8701-1a39ae2bee4f None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.584135 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.584756 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.585032 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.585201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.585308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.589943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.590076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] RBAC: Adding query filter params (role.id=b233f3c68dc749d1808da33222469071, user.id=c07dcac0537a462497484facd373edea, scope.system=all) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:20.590151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.590151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] PATH_INFO: `/v3/groups` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.590269 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:20.590399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:20.590471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.590536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.602339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 154/305] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/role_assignments?user.id=c07dcac0537a462497484facd373edea&scope.system=all&role.id=b233f3c68dc749d1808da33222469071 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:20.602339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.654751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:20.671486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 152/306] 10.222.0.48 () {60 vars in 1134 bytes} [Mon Jul 25 23:02:20 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:20.738303 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6b8d1-940e-4bba-989e-4c6f5e6c40da None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.784679 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.785707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.786208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.786706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.801698 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:20.806712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:20.807629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:20.808406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 155/307] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:20.814657 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:20.836908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:20.929731 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75c95-49c2-48d3-ad2f-7cd1adeb452e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:20.969682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:20.970848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:20.971354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:20.971879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:20.972841 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:20.973385 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:20.975140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dacb7f-f760-46f9-ae8e-8e8d6b75898e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:20.987912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 153/308] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:20.994997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.119963 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:21.119963 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b907c70-6d10-4576-9e75-f1160b8f5c2c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.130649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d80d4-20b0-495a-aad8-56da0dda2670 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.131185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d80d4-20b0-495a-aad8-56da0dda2670 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.131278 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d80d4-20b0-495a-aad8-56da0dda2670 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.132852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 154/309] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:21.138186 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.138508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.138787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.155471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.156404 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.156855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.157298 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] PATH_INFO: `/v3/users/e60a3ddc4101418c9b8bb8c1f30ddd11` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.158475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:21.159041 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=e60a3ddc4101418c9b8bb8c1f30ddd11)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:21.159878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:21.160835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:21.163878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 156/310] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:20 2022] GET /identity/v3/users/e60a3ddc4101418c9b8bb8c1f30ddd11 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:21.171155 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.238515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 155/311] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:21.257385 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.268670 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:21.300488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3658e8-098c-4080-a1a1-1d445f386ee8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.342253 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.343243 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.343667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.344164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] PATH_INFO: `/v3/system/users/e60a3ddc4101418c9b8bb8c1f30ddd11/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.346013 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e60a3ddc4101418c9b8bb8c1f30ddd11, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:21.347594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:21.386325 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f2e6c-4fa8-41e8-a726-b434946b9e49 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.418642 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 157/312] 10.222.0.48 () {58 vars in 1334 bytes} [Mon Jul 25 23:02:21 2022] PUT /identity/v3/system/users/e60a3ddc4101418c9b8bb8c1f30ddd11/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:21.431804 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.432481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.432764 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.433041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.447034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:21.453294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:21.454247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:21.455338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 156/313] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:21.462612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.498530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:21.580120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae6f2-7775-4a11-81e7-bacb77d30244 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.618153 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.618813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.619093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.619365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.620085 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] RBAC: Adding query filter params (name=reader) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:21.620388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:21.622425 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:21.634231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 158/314] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:21.637153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.722438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:21.757406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e97c89-8ae6-435c-89ec-d52776a9f71c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.795938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.796613 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.796894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.797164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] PATH_INFO: `/v3/users/71cb0251cb914a3c99a62ab54c4bc770` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:21.798461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] RBAC: Authorizing `identity:get_user(user_id=71cb0251cb914a3c99a62ab54c4bc770)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:21.799936 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:21.806451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 157/315] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:21 2022] GET /identity/v3/users/71cb0251cb914a3c99a62ab54c4bc770 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:21.807899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:21.905988 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:21.914733 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1390-47f4-4597-a594-b7f63021deba None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:21.949496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:21.950762 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:21.951316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:21.951316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.024541 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:22.026013 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:22.119662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:22.134309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:22.135657 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:22.247896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d6eb1-a73d-4b85-bab4-c8a4d6b13a19 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:22.283840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0582b68-63fb-4b67-acda-73a24bde2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:22.284482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0582b68-63fb-4b67-acda-73a24bde2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:22.284756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0582b68-63fb-4b67-acda-73a24bde2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:22.285025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0582b68-63fb-4b67-acda-73a24bde2dd2 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.286179 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0582b68-63fb-4b67-acda-73a24bde2dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:22.287808 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0582b68-63fb-4b67-acda-73a24bde2dd2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:22.294419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 158/317] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:22 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:22.295966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:22.399928 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512c43a-087f-457d-878b-e44e4dcca56a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:22.436724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:22.437370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:22.437634 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:22.437878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.438691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] RBAC: Adding query filter params (role.id=b233f3c68dc749d1808da33222469071, scope.project.id=153dbedcd8164a2ea26cebf124ccb842, user.id=71cb0251cb914a3c99a62ab54c4bc770) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:22.439052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:22.440540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f73f4-b114-4a7b-bf56-1e824de2038d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:22.452842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 160/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:22 2022] GET /identity/v3/role_assignments?user.id=71cb0251cb914a3c99a62ab54c4bc770&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=b233f3c68dc749d1808da33222469071 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:22.919998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6629104-e054-4fe0-a88d-f5351a41a8a9 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:22.920354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6629104-e054-4fe0-a88d-f5351a41a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:22.920559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6629104-e054-4fe0-a88d-f5351a41a8a9 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.922060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 159/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:22.927008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3c18c-3ce5-4c0d-87b8-d1175a945442 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:22.927297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3c18c-3ce5-4c0d-87b8-d1175a945442 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:22.927572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3c18c-3ce5-4c0d-87b8-d1175a945442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:22.945892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-62b3c18c-3ce5-4c0d-87b8-d1175a945442 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:22.947373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-62b3c18c-3ce5-4c0d-87b8-d1175a945442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:23.001922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.020094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 161/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:23.044924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6629104-e054-4fe0-a88d-f5351a41a8a9 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.048998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.148743 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6629104-e054-4fe0-a88d-f5351a41a8a9 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.155287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bfc3a-c65a-41d2-af73-4f12476ec862 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.155744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bfc3a-c65a-41d2-af73-4f12476ec862 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.155981 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bfc3a-c65a-41d2-af73-4f12476ec862 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.157464 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 162/321] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:02:23.162166 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.162472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.162745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.195755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:23.196929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:23.221843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.222865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.223143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.223420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.234831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:23.240257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:23.241201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:23.242030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 160/322] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:23.247647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.271326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 163/323] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:23.294977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.314168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.355228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667e95e-d48e-4916-bdb4-d5a8959ab94f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.392671 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.393328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.393614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.394241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.395001 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:23.395307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.396684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.403047 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecbd10-9564-4511-b8cb-e22b2ab1a9e2 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.405885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 161/324] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:23.411314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.425463 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.445598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.446352 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.446819 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.446819 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.448071 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.449513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.451496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 164/325] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:23.459173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.530761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4917e61-9cf6-4a22-914b-872b7653375f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.558606 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.568713 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.570320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.570320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.570320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] PATH_INFO: `/v3/users/c07dcac0537a462497484facd373edea` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.570613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c75b5-ad55-4be0-8f8d-49ebd7d4dff3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.571450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c07dcac0537a462497484facd373edea)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.573257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.579371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 162/326] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/users/c07dcac0537a462497484facd373edea => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:23.580138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:23.617338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17fcd9-96e0-4e71-9ec6-60cff9598b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.617909 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17fcd9-96e0-4e71-9ec6-60cff9598b23 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.618170 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17fcd9-96e0-4e71-9ec6-60cff9598b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.618482 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17fcd9-96e0-4e71-9ec6-60cff9598b23 None admin] PATH_INFO: `/v3/groups` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.619175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17fcd9-96e0-4e71-9ec6-60cff9598b23 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.620658 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17fcd9-96e0-4e71-9ec6-60cff9598b23 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.693867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cffa4-949c-4c1b-b05b-867eb8c8d5e8 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:23.722418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 165/327] 10.222.0.48 () {60 vars in 1134 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/groups => generated 226 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:23.737338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:23.738370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.738813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.739257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] PATH_INFO: `/v3/system/users/c07dcac0537a462497484facd373edea/roles/b233f3c68dc749d1808da33222469071` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.741029 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c07dcac0537a462497484facd373edea, role_id=b233f3c68dc749d1808da33222469071)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:23.742747 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:23.788899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28af8d-ee62-404b-bb39-c115e8a33c1d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.789182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28af8d-ee62-404b-bb39-c115e8a33c1d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.789457 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28af8d-ee62-404b-bb39-c115e8a33c1d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.790927 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 166/328] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:02:23.797301 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:23.797590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:23.797870 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:23.817240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:23.818501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:23.826945 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 163/329] 10.222.0.48 () {58 vars in 1334 bytes} [Mon Jul 25 23:02:23 2022] PUT /identity/v3/system/users/c07dcac0537a462497484facd373edea/roles/b233f3c68dc749d1808da33222469071 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:23.869872 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:23.911661 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 167/330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:23.936585 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.002083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:24.051941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662fb03-6bff-44c6-8520-7d59cc1c8dc0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.089674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.090364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.090638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.090917 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.102134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:24.108138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:24.113242 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:24.114043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 164/331] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:24.116117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.227600 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661960e-d4ae-4b88-930d-0c6253bce3f8 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.265395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.265956 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.266243 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.266542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.267270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:24.267582 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:24.268968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.278482 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 168/332] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:24.283947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.420207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca490c7-d68e-4380-9e28-8c609febe7b0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.444239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:24.470966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35408-77fc-438e-a8ec-7e135aedb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.471965 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35408-77fc-438e-a8ec-7e135aedb5bb None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.472457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35408-77fc-438e-a8ec-7e135aedb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.472927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35408-77fc-438e-a8ec-7e135aedb5bb None admin] PATH_INFO: `/v3/users/e60a3ddc4101418c9b8bb8c1f30ddd11` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.474398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35408-77fc-438e-a8ec-7e135aedb5bb None admin] RBAC: Authorizing `identity:get_user(user_id=e60a3ddc4101418c9b8bb8c1f30ddd11)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:24.476108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35408-77fc-438e-a8ec-7e135aedb5bb None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.477918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:24 2022] GET /identity/v3/users/e60a3ddc4101418c9b8bb8c1f30ddd11 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:24.484371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:24.533783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:24.612865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e939d82-517d-4a74-a9d0-09bd138020fd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:24.650905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:24.651541 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:24.652073 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:24.652350 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:24.653817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] RBAC: Adding query filter params (role.id=def5a58760984080ab8717cb294b3f64, user.id=e60a3ddc4101418c9b8bb8c1f30ddd11, scope.system=all) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:24.654120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:24.655593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf1896-74cf-4c10-aed5-f68b50f9b44f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:24.668638 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 169/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 23:02:24 2022] GET /identity/v3/role_assignments?user.id=e60a3ddc4101418c9b8bb8c1f30ddd11&scope.system=all&role.id=def5a58760984080ab8717cb294b3f64 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:26.280369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc1e8d-c3c8-4e96-8d21-8c756042e99b None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.280919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc1e8d-c3c8-4e96-8d21-8c756042e99b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.280919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc1e8d-c3c8-4e96-8d21-8c756042e99b None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.282427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:26.288666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266a01-9386-4466-9201-a23256712d27 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.289513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266a01-9386-4466-9201-a23256712d27 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.290009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14266a01-9386-4466-9201-a23256712d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.313326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-14266a01-9386-4466-9201-a23256712d27 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:26.314887 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-14266a01-9386-4466-9201-a23256712d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:26.403689 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:26.445236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc1e8d-c3c8-4e96-8d21-8c756042e99b None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.594457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc1e8d-c3c8-4e96-8d21-8c756042e99b None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:26.633935 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10dc05-f951-4f5c-8024-000ee1ef3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:26.634761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10dc05-f951-4f5c-8024-000ee1ef3854 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.635042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10dc05-f951-4f5c-8024-000ee1ef3854 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.635314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10dc05-f951-4f5c-8024-000ee1ef3854 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.649378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10dc05-f951-4f5c-8024-000ee1ef3854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-cf10dc05-f951-4f5c-8024-000ee1ef3854 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:26.655159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:26.656059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:26.656838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 167/337] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:26.663795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266a01-9386-4466-9201-a23256712d27 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.697784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:26.791724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14266a01-9386-4466-9201-a23256712d27 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:26.807618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167a0e-7351-4040-8eb4-416bceace45a None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.807927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167a0e-7351-4040-8eb4-416bceace45a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.808180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167a0e-7351-4040-8eb4-416bceace45a None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.814419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 168/338] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:26.815678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.815964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.816241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.847544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:26.848855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:26.868656 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:26.870450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:26.870957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:26.871731 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:26.873105 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:26.874022 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:26.875652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:26.894911 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 171/339] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:26.902571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:26.930739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:26.987077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 169/340] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:27.034008 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:27.038157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:27.065335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55523210-1c4c-4171-af01-edb11e032803 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:27.121241 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:27.122392 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.122882 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.123379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] PATH_INFO: `/v3/users/c07dcac0537a462497484facd373edea` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.127489 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] RBAC: Authorizing `identity:get_user(user_id=c07dcac0537a462497484facd373edea)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:27.129493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:27.132686 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 172/341] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 23:02:26 2022] GET /identity/v3/users/c07dcac0537a462497484facd373edea => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:27.140633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:27.217986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7329e-fdac-4a04-96b4-dc64c6616ff4 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:27.280508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa5adc-c19e-4011-bf83-ef1b7f4c6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:27.281271 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5adc-c19e-4011-bf83-ef1b7f4c6d04 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.281456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5adc-c19e-4011-bf83-ef1b7f4c6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.281720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5adc-c19e-4011-bf83-ef1b7f4c6d04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.302175 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa5adc-c19e-4011-bf83-ef1b7f4c6d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-62aa5adc-c19e-4011-bf83-ef1b7f4c6d04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:27.308124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:27.309061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:27.309924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 170/342] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:27.311304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a06-ee9e-4447-a134-75329a0f4f3e None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a06-ee9e-4447-a134-75329a0f4f3e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a06-ee9e-4447-a134-75329a0f4f3e None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 171/343] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:27.319180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb2a06-ee9e-4447-a134-75329a0f4f3e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:27.328646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75097b1d-21a7-4e80-8f52-32e464e4f80c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:27.388157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:27.389812 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.390105 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.390642 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:27.391773 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.392603 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] RBAC: Adding query filter params (role.id=b233f3c68dc749d1808da33222469071, user.id=c07dcac0537a462497484facd373edea, scope.system=all) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:27.392918 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:27.398751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53f32-1f5a-4797-8c70-889bf3fd3c60 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:27.425806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 173/344] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 23:02:27 2022] GET /identity/v3/role_assignments?user.id=c07dcac0537a462497484facd373edea&scope.system=all&role.id=b233f3c68dc749d1808da33222469071 => generated 510 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:27.427796 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.428176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.428461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.469056 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:27.470563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:27.493100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:27.532175 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb2a06-ee9e-4447-a134-75329a0f4f3e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:27.609699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:27.610358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.610643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.610958 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.611691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:27.611995 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:27.613387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ee0f-b315-4b99-bda5-a2748e79e419 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:27.624600 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 174/345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:27.632133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 172/346] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:27.637789 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:27.685906 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996bba-50a2-45e2-875a-7f75ec07d194 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.686621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996bba-50a2-45e2-875a-7f75ec07d194 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.687147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996bba-50a2-45e2-875a-7f75ec07d194 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.689042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 173/347] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:27.694314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39996bba-50a2-45e2-875a-7f75ec07d194 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:27.787341 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a13f-a68a-4d88-bff7-3c6e22862fc5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:27.830823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:27.840992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39996bba-50a2-45e2-875a-7f75ec07d194 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:27.848648 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:27.849486 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.849913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.850581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.873035 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:27.908422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9538d8c-541c-4cf0-80f2-bf2d68e30733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:27.909085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9538d8c-541c-4cf0-80f2-bf2d68e30733 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.909364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9538d8c-541c-4cf0-80f2-bf2d68e30733 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.909637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9538d8c-541c-4cf0-80f2-bf2d68e30733 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.932604 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9538d8c-541c-4cf0-80f2-bf2d68e30733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-e9538d8c-541c-4cf0-80f2-bf2d68e30733 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:27.938131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:27.939081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:27.939892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:27.940539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 174/348] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:27.941684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:27.941972 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:27.942251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:27.951880 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:27.953597 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:27.968009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:27.969401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:28.060134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 175/349] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:28.060945 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.092980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 175/350] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:28.098827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.164537 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:28.168102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:28.186119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6137-9d31-43b9-8378-1ba9bfe046b0 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.226669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.227218 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.227509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.227881 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.228612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:28.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:28.231399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:28.242264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ebc1-a0b1-414d-b212-87a90c0eb86d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.243288 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:28.244277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.288034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.288928 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.289216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.289492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.291618 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:28.293064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:28.295806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:28.296599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.368813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eda5d-8a75-468e-8ead-6aaa4281c487 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.410874 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.411841 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.412599 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.412881 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.426036 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:28.433973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:28.435314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:28.436108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 177/353] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:28.436776 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.439743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075793-5fd8-43c5-8d87-ffaaaebc6331 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.452057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:28.454381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:28.479977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd262d-a70f-40c9-b16f-d66f9ed8db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.480531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd262d-a70f-40c9-b16f-d66f9ed8db9e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.480811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd262d-a70f-40c9-b16f-d66f9ed8db9e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.481181 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd262d-a70f-40c9-b16f-d66f9ed8db9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.569351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e2563-cdc0-400f-af16-f1bc50d09df4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.569550 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd262d-a70f-40c9-b16f-d66f9ed8db9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:28.569550 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd262d-a70f-40c9-b16f-d66f9ed8db9e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:28.608458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.609126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.609409 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.609687 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.617146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:28.618668 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:28.620770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 178/354] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:28.621425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.711914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 177/355] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:28.713504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c879-bc18-4c3a-8a75-3b449df11700 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.713504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c879-bc18-4c3a-8a75-3b449df11700 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.713504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c879-bc18-4c3a-8a75-3b449df11700 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.715998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 178/356] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:28.716757 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c879-bc18-4c3a-8a75-3b449df11700 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.726902 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:28.748723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:28.761172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104542-4f3b-46a5-86f4-86375882be2d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.809810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.811301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.811584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.811859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.812587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:28.812891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:28.814273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39369b00-6dd7-434b-8799-b4858d2a085a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:28.827157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 179/357] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:28.832758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.833185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.833460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.850330 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c879-bc18-4c3a-8a75-3b449df11700 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:28.859934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:28.863535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:28.899004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:28.903222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:28.903222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:28.903222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:28.903222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=a1754e4951234624ac0ae407c871458f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:28.903222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:28.907206 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:28.909638 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 179/358] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=75ed1976f12e48b38908f23e51856c1e => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:28.912271 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:28.945449 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 180/359] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:28.946372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.031936 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.035028 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.067444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b521-6159-414e-a406-43dd25d5a15a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.072097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7c505-c554-4027-a9b0-9d115c13280e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.106430 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.107510 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.107993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.108467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.110731 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:29.112436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:29.114676 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4ec7a-54eb-475e-8e3d-4dda1fbcc4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.114959 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 180/360] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:29.115262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4ec7a-54eb-475e-8e3d-4dda1fbcc4f4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.115544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4ec7a-54eb-475e-8e3d-4dda1fbcc4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.115819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4ec7a-54eb-475e-8e3d-4dda1fbcc4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.116582 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.209149 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4ec7a-54eb-475e-8e3d-4dda1fbcc4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:29.211495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4ec7a-54eb-475e-8e3d-4dda1fbcc4f4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:29.241115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e25eea-96fd-4e67-b511-897726a7f040 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.297761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.297761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.297761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.297761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.299826 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.316494 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:29.322730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:29.323643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:29.324445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 181/361] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:29.325704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.328901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.348924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 181/362] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:29.350340 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c88ed-ac2d-4c05-8b84-7ca643392d4f None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.350618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c88ed-ac2d-4c05-8b84-7ca643392d4f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.350899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c88ed-ac2d-4c05-8b84-7ca643392d4f None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.352169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 182/363] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:29.352866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c88ed-ac2d-4c05-8b84-7ca643392d4f None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.446395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438ff7-9610-4ee1-be2e-9d796150867e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.493079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.494048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.494325 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.494612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.495811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:29.497416 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:29.498383 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c88ed-ac2d-4c05-8b84-7ca643392d4f None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.499399 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 182/364] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:29.500195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.555097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.556130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.556608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.557043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.557930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:29.558230 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:29.560681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4a878-32d8-48cc-b983-6287e62407d6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:29.569638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 183/365] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:29.571869 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.572664 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.573144 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.592593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.613028 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:29.614482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:29.639135 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ab383-0a45-4197-aaff-20938fd3b0ac None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.645676 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.680703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.682263 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.682698 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.683438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.684619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:29.688441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:29.690719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 183/366] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:29.694941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.703253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 184/367] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:29.704439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.839318 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643699-5bda-4ee0-aa51-f6f89de3222b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.842079 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626ce0-a156-4160-a735-4c26ed84ea64 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:29.884682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.885323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.885606 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.885884 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.886714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=a1754e4951234624ac0ae407c871458f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:29.887020 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:29.888596 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:29.891562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:29.892196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:29.892479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:29.892754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:29.899907 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 184/368] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=def5a58760984080ab8717cb294b3f64 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:29.900738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:29.908310 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:29.955793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:30.063092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.064822 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.084340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218e58-88f2-4328-b338-8f690151c667 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.156605 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594450e-e571-459c-9759-37743a651259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.158437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594450e-e571-459c-9759-37743a651259 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.158437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594450e-e571-459c-9759-37743a651259 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.158644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594450e-e571-459c-9759-37743a651259 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.160880 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594450e-e571-459c-9759-37743a651259 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.163210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594450e-e571-459c-9759-37743a651259 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.168188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 185/369] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:30.168188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594450e-e571-459c-9759-37743a651259 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.206095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 185/370] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:30.207458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.250668 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:30.270735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:30.285968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594450e-e571-459c-9759-37743a651259 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.315588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea03c8-25af-4fcc-85e5-068c60e838c1 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.328841 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.330249 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.330755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.333589 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.363240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:30.368520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:30.369145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:30.370207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:30.374471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:30.375094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.375094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.375094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.375094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=153dbedcd8164a2ea26cebf124ccb842) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:30.375094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.375094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.377320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 186/371] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:30.378379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.380238 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 186/372] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=def5a58760984080ab8717cb294b3f64 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:30.387767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.505243 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07457ad4-1275-4b32-934b-efe5e2ab7293 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.529414 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d6b71-5ab9-419f-9f8f-7776784d87c0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.532740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:30.555344 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.556063 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.556262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.556537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.557267 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:30.557589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.563043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.564626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:30.575383 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.576439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.576884 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.579120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.582362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.582870 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 187/373] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:30.584527 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.586504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 187/374] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:30.588350 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.596310 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.735997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0299d-3cae-4467-bdec-ec8159847823 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.774511 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.775445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.775995 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.776465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.781170 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.782926 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.785063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 188/375] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:30.790858 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:30.808044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58740-f07f-4cf6-af5e-04aec7d619c0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.872846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:30.881685 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.882447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.882737 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.893923 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.915068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a5fcf-ceba-4e2b-bf15-80f9c6cdc640 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:30.962601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:30.963527 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:30.964048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:30.964514 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:30.966030 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=153dbedcd8164a2ea26cebf124ccb842) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:30.966638 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:30.969291 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:30.976255 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 189/376] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=75ed1976f12e48b38908f23e51856c1e => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:31.009374 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:31.039001 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:31.040430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:31.183521 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 188/377] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:31.189599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:31.301378 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34ad7-7091-4ee7-bbf1-6c50d23a0175 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:31.334048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:31.339980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:31.340960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:31.341442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:31.341936 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] PATH_INFO: `/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:31.343431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] RBAC: Authorizing `identity:get_project(project_id=4fb3fc79734a41949ef7b41a3d86f9ef)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:31.345087 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:31.347241 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 190/378] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:31 2022] GET /identity/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:31.353296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:31.478323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:31.495805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75f12-48eb-4ee7-90ee-0c5a272c7068 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:31.546025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d64a-1f24-4776-9a46-fc007584ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:31.546808 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d64a-1f24-4776-9a46-fc007584ec55 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:31.547027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d64a-1f24-4776-9a46-fc007584ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:31.547307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d64a-1f24-4776-9a46-fc007584ec55 None admin] PATH_INFO: `/v3/groups/7726e1ddfb814c9d8703c7599f162d71` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:31.554056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d64a-1f24-4776-9a46-fc007584ec55 None admin] RBAC: Authorizing `identity:get_group(group_id=7726e1ddfb814c9d8703c7599f162d71)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:31.555529 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d64a-1f24-4776-9a46-fc007584ec55 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:31.557647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 189/379] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:31 2022] GET /identity/v3/groups/7726e1ddfb814c9d8703c7599f162d71 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:31.564752 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:31.717188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cf5bf-342b-4f9c-906b-517885bd5777 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:31.761814 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:31.763270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:31.763553 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:31.763830 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:31.764632 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] RBAC: Adding query filter params (group.id=7726e1ddfb814c9d8703c7599f162d71, role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=4fb3fc79734a41949ef7b41a3d86f9ef) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:31.764944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:31.766496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d29c-5b68-4649-91a6-c9123944d76c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:31.772961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 191/380] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:31 2022] GET /identity/v3/role_assignments?group.id=7726e1ddfb814c9d8703c7599f162d71&scope.project.id=4fb3fc79734a41949ef7b41a3d86f9ef&role.id=b808049b0af24ba79f7b5a53a732242d => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:31.841618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70e6ac-c05a-4204-b4b1-3247ae92efb3 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:31.841940 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70e6ac-c05a-4204-b4b1-3247ae92efb3 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:31.842172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70e6ac-c05a-4204-b4b1-3247ae92efb3 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:31.843938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 190/381] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:31.849847 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:31.850139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:31.850459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:31.869576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:31.872450 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:31.955120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:31.966067 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 192/382] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:32.002893 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70e6ac-c05a-4204-b4b1-3247ae92efb3 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:32.143001 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70e6ac-c05a-4204-b4b1-3247ae92efb3 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:32.188158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:32.189170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:32.189653 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:32.190150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:32.205930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:32.211210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:32.212111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:32.212894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:32.215693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 191/383] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:32.221360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:32.353624 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f6ac0-0fed-440f-a7eb-5573e09a35f4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:32.397848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:32.398459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:32.398740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:32.399013 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:32.399737 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:32.400039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:32.401403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:32.411005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 193/384] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:32.416719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:32.436402 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:32.573654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ecdb3-c846-4217-8d3e-7fea831ee838 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:32.625761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:32.626443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:32.626728 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:32.627010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:32.628328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:32.629786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:32.631831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 192/385] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:32 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:32.637718 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:32.722428 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:32.781167 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8d9c5-14b8-4c05-a85e-c873469f01a2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:32.821839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bd799-f036-4389-bc46-26c9f31deb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:32.822885 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bd799-f036-4389-bc46-26c9f31deb0f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:32.823399 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bd799-f036-4389-bc46-26c9f31deb0f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:32.823875 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bd799-f036-4389-bc46-26c9f31deb0f None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:32.826455 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bd799-f036-4389-bc46-26c9f31deb0f None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:32.828112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bd799-f036-4389-bc46-26c9f31deb0f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:32.830036 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:32 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:32.839346 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:32.976586 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:33.002725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a312b1c-f7dc-42e3-a169-97adec09d991 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:33.049689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:33.050413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.050691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.050967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/75ed1976f12e48b38908f23e51856c1e` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.053144 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1754e4951234624ac0ae407c871458f, group_id=afbceab8fecc42de9b7a48864aa64f5d, role_id=75ed1976f12e48b38908f23e51856c1e)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:33.054615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:33.155419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2ee0-fc14-4eab-bc98-7e974b15cdf4 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.156031 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2ee0-fc14-4eab-bc98-7e974b15cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.156486 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2ee0-fc14-4eab-bc98-7e974b15cdf4 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.158354 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 195/387] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:33.163307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.163827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.164301 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.186854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:33.188052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:33.197311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 193/388] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 23:02:32 2022] PUT /identity/v3/projects/a1754e4951234624ac0ae407c871458f/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/75ed1976f12e48b38908f23e51856c1e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:33.281193 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 196/389] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:33.320431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:33.468686 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a392-8d23-466d-924b-3c5b2b28ee07 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:33.510411 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8dffe-98cb-4b47-b1ac-296e1bbcc2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:33.511074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8dffe-98cb-4b47-b1ac-296e1bbcc2bb None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.511351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8dffe-98cb-4b47-b1ac-296e1bbcc2bb None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.511622 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8dffe-98cb-4b47-b1ac-296e1bbcc2bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.517428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:33.526177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8dffe-98cb-4b47-b1ac-296e1bbcc2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-23b8dffe-98cb-4b47-b1ac-296e1bbcc2bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:33.532203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:33.533081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:33.533865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 194/390] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:33.541632 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:33.606064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:33.610937 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f1c7-6415-49f4-bd16-dbe5a2671d4f None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.612205 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f1c7-6415-49f4-bd16-dbe5a2671d4f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.612975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18f1c7-6415-49f4-bd16-dbe5a2671d4f None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.615431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 195/391] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:33.621959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.621959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.622250 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.642265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:33.643930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:33.688025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a593db3-5c86-48ac-a265-369687d807f6 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:33.733818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 196/392] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:33.761550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:33.773813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:33.774770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:33.775051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:33.775324 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:33.776048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:33.776354 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:33.778211 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:33.797824 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 197/393] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:33.804078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:33.945251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b04720-b533-44d3-a35d-64b47794d1dc None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:33.983417 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988bc0c-4141-4ae2-95e5-93e9b15719de None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:33.986409 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:33.999572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:34.009712 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948445fb-1a07-4429-aa41-ffaf7d39d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.010389 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948445fb-1a07-4429-aa41-ffaf7d39d18f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.010670 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948445fb-1a07-4429-aa41-ffaf7d39d18f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.010942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948445fb-1a07-4429-aa41-ffaf7d39d18f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.030310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948445fb-1a07-4429-aa41-ffaf7d39d18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:34.034551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d33e3-8eea-4c71-abdb-9d6f4a828090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.035182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d33e3-8eea-4c71-abdb-9d6f4a828090 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.035529 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d33e3-8eea-4c71-abdb-9d6f4a828090 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-948445fb-1a07-4429-aa41-ffaf7d39d18f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:34.035632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:34.036448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:34.037236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:34.037836 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d33e3-8eea-4c71-abdb-9d6f4a828090 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.037905 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:34.037968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d33e3-8eea-4c71-abdb-9d6f4a828090 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.038033 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77dc01-9266-4c8a-a2bb-8e0a0fcfbd72 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.042324 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77dc01-9266-4c8a-a2bb-8e0a0fcfbd72 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.047136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d33e3-8eea-4c71-abdb-9d6f4a828090 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.047334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77dc01-9266-4c8a-a2bb-8e0a0fcfbd72 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.047334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 198/395] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:34.047334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77dc01-9266-4c8a-a2bb-8e0a0fcfbd72 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.047526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:33 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.047526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.047526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.047706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.072493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:34.073890 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:34.148878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 199/397] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:34.150325 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.195725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77dc01-9266-4c8a-a2bb-8e0a0fcfbd72 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.243699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.244327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.244610 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.244883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.245603 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:34.245908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.247948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.260440 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 199/398] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.261348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.276156 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318a4b5-7dc1-428d-a03e-5f7106b379c7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.291905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:34.317045 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:34.317282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.318200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.318606 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.318970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.320565 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.322190 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.325323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.326549 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.384701 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae587-c5b3-4ad8-af5d-3fa6851cfc9d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.429084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.430128 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.430451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.430723 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.444915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:34.447106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09daf5-e275-4d22-a31a-1f6d4dee7394 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:34.451693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:34.452621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:34.453430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:34.458353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 200/400] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:34.459406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.493226 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.493881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.494216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.494521 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.497085 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.499346 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.502327 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 201/401] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.503135 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.560204 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:34.590356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e941a9-7e8e-41f7-a090-49f8261c0e4f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.604270 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:34.627149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247da2-fb30-48cd-a694-1b7ed6d91184 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.639536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.640836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.641268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.641703 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.643938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1754e4951234624ac0ae407c871458f, group_id=afbceab8fecc42de9b7a48864aa64f5d, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.645601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.667248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.667961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.668835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.669183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.669962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:34.670365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.671802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.686501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 202/402] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.686501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.715813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 201/403] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 23:02:34 2022] PUT /identity/v3/projects/a1754e4951234624ac0ae407c871458f/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:34.717738 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.826385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc19ad2-85ec-44d7-8623-8ce4aa613b28 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.840445 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:34.878134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458083aa-3583-4b78-b12d-c522de82ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.880125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458083aa-3583-4b78-b12d-c522de82ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.880602 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458083aa-3583-4b78-b12d-c522de82ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.881216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458083aa-3583-4b78-b12d-c522de82ebb8 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.882850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458083aa-3583-4b78-b12d-c522de82ebb8 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.885141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458083aa-3583-4b78-b12d-c522de82ebb8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.889044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.890914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f8ece-024e-4a3b-8b4f-5fe5e55a04d1 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.891609 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f8ece-024e-4a3b-8b4f-5fe5e55a04d1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.892108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f8ece-024e-4a3b-8b4f-5fe5e55a04d1 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.894894 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 204/405] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:34.895864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f8ece-024e-4a3b-8b4f-5fe5e55a04d1 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:34.921949 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023cc7-bf64-4be4-8f82-a84827fad5e2 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:34.974797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973f05-d34b-4783-981e-212e894fb4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:34.975455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973f05-d34b-4783-981e-212e894fb4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.975741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973f05-d34b-4783-981e-212e894fb4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.976027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973f05-d34b-4783-981e-212e894fb4d3 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:34.977179 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973f05-d34b-4783-981e-212e894fb4d3 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:34.978657 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973f05-d34b-4783-981e-212e894fb4d3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:34.980263 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 202/406] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:34 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:34.982224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:34.982561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:34.982824 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.001370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:35.002309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:35.024630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f8ece-024e-4a3b-8b4f-5fe5e55a04d1 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:35.037780 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:35.067411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:35.068511 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.069000 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.069478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.071779 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=153dbedcd8164a2ea26cebf124ccb842, group_id=afbceab8fecc42de9b7a48864aa64f5d, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:35.073442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:35.086306 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 203/407] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:35.086306 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:35.173332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 205/408] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 23:02:34 2022] PUT /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:35.174516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:35.234553 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e54aa-6b3d-471f-bae0-ef60ed33518b None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:35.253122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:35.306102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:35.306809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.307092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.307370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.309893 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:35.311532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:35.313329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 204/409] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:35 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:35.319433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:35.373117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0f12-9401-419e-9d50-0bba32e669f9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:35.393100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:35.422760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:35.423487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.423714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.424256 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.441062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:35.451183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:35.452096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:35.452878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:35.454122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 206/410] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:35.460525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:35.505684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd77eb-6562-4a67-8760-a74c1595b900 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:35.559707 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:35.560396 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.561547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.561547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/75ed1976f12e48b38908f23e51856c1e` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.563669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] RBAC: Authorizing `identity:create_grant(project_id=153dbedcd8164a2ea26cebf124ccb842, group_id=afbceab8fecc42de9b7a48864aa64f5d, role_id=75ed1976f12e48b38908f23e51856c1e)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:35.565151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:35.593300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030933-529d-4bed-be34-8e6aab5c1d9b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:35.598090 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:35.639471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:35.640341 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.642053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.642587 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.644200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:35.644525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:35.649012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:35.650552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 205/411] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 23:02:35 2022] PUT /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842/groups/afbceab8fecc42de9b7a48864aa64f5d/roles/75ed1976f12e48b38908f23e51856c1e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:35.661381 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 207/412] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:35.667344 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:35.791618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa368-ade5-452b-9114-5ad1f5a7386e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:35.794616 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:35.830959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfc6b0-ee2d-42d3-9cd5-ab40503b7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:35.831674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc6b0-ee2d-42d3-9cd5-ab40503b7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.831963 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc6b0-ee2d-42d3-9cd5-ab40503b7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.832238 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfc6b0-ee2d-42d3-9cd5-ab40503b7bb4 None admin] PATH_INFO: `/v3/groups/7726e1ddfb814c9d8703c7599f162d71` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.833507 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc6b0-ee2d-42d3-9cd5-ab40503b7bb4 None admin] RBAC: Authorizing `identity:get_group(group_id=7726e1ddfb814c9d8703c7599f162d71)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:35.835295 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfc6b0-ee2d-42d3-9cd5-ab40503b7bb4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:35.837228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 206/413] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:35 2022] GET /identity/v3/groups/7726e1ddfb814c9d8703c7599f162d71 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:35.843433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:35.864498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c605b-e5ff-4fcb-abd0-6d69611be032 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.864883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c605b-e5ff-4fcb-abd0-6d69611be032 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.865219 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c605b-e5ff-4fcb-abd0-6d69611be032 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.866816 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 207/414] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:02:35.875997 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:35.876743 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:35.877354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:35.900049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:35.902041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:35.997627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 208/415] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:36.010175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa829c-9036-4567-846a-5a554b4ec7da None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:36.024334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:36.052250 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:36.053175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:36.053601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:36.054076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] PATH_INFO: `/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:36.055742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] RBAC: Authorizing `identity:get_project(project_id=4fb3fc79734a41949ef7b41a3d86f9ef)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:36.057361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:36.060239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 208/416] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:35 2022] GET /identity/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:36.066764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:36.110714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:36.186920 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f9842-0c69-4e9c-a9fe-b9571c31917d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:36.196822 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:36.224413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f247e0-48ad-4b0a-aad3-02f09c4c3689 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:36.228494 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:36.229357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:36.229783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:36.230227 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] PATH_INFO: `/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef/groups/7726e1ddfb814c9d8703c7599f162d71/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:36.233309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] RBAC: Authorizing `identity:create_grant(project_id=4fb3fc79734a41949ef7b41a3d86f9ef, group_id=7726e1ddfb814c9d8703c7599f162d71, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:36.235430 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:36.275922 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:36.277228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:36.277793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:36.278388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:36.289971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:36.296381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:36.297458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:36.298463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:36.300885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 209/417] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:36.306836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:36.322742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 209/418] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 23:02:36 2022] PUT /identity/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef/groups/7726e1ddfb814c9d8703c7599f162d71/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:36.435654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f767-46a3-4bee-9022-b50c6b863fd5 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:36.474617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:36.475526 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:36.475952 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:36.476429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:36.477322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:36.477778 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:36.479344 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:36.489633 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:36.495588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:36.606679 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:36.619895 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51594d4-4592-4291-9743-0b8f3b3102fc None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:36.657476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:36.658106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:36.658438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:36.658876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:36.731074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:36.732539 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:36.861474 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:36.881314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 210/420] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:36.887312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:36.913805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:37.002556 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855c70-22fc-431e-85fc-74eee2806387 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:37.038067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:37.038762 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:37.039044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:37.039319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:37.040483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:37.041926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:37.044161 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:36 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:37.049696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:37.164370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de96ce-e105-4629-888f-fa1b7d50cc70 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:37.199102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccd5c0-bef2-48a9-b082-ca8164fcc597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:37.200361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccd5c0-bef2-48a9-b082-ca8164fcc597 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:37.200640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccd5c0-bef2-48a9-b082-ca8164fcc597 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:37.200916 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccd5c0-bef2-48a9-b082-ca8164fcc597 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:37.202081 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccd5c0-bef2-48a9-b082-ca8164fcc597 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:37.209858 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccd5c0-bef2-48a9-b082-ca8164fcc597 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:37.209858 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 211/422] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:37 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:37.211397 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:37.301406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:37.320912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487bad3-5202-4716-80a3-3e56d1b88e0f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:37.356580 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:37.357210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:37.357492 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:37.357766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:37.358584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=a1754e4951234624ac0ae407c871458f) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:37.358891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:37.360334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07811dd7-ef93-4d16-93f9-7933f77a14b1 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:37.366871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:37 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=75ed1976f12e48b38908f23e51856c1e => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:37.549458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7830de3-3f64-466a-a647-388ab1c7c432 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:37.549838 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7830de3-3f64-466a-a647-388ab1c7c432 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:37.550056 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7830de3-3f64-466a-a647-388ab1c7c432 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:37.551786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 212/424] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:37.560981 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:37.561272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:37.561552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:37.582174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:37.583392 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:37.653471 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 213/425] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:37.678100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7830de3-3f64-466a-a647-388ab1c7c432 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:37.743875 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:37.795694 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7830de3-3f64-466a-a647-388ab1c7c432 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:37.835384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:37.835957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:37.836289 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:37.836568 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:37.849711 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:37.854883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:37.856418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:37.857491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 213/426] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:37.864471 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:37.951275 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:37.975021 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183374a-3fe2-4e1d-9f3a-e73846ce53c3 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.011239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.012586 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.012900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.013175 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.013898 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:38.014198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:38.015601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c7e51-f16b-4799-8569-169fe8458eb5 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:38.024749 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 214/427] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:38.031370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.144121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f363b0-dcea-4aab-9d19-2d92c8c355c7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.162628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:38.181436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.182066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.182371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.182647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.254066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:38.255598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:38.267707 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c915d9-7255-4cad-a766-dd1196c093fa None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.268291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c915d9-7255-4cad-a766-dd1196c093fa None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.268786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c915d9-7255-4cad-a766-dd1196c093fa None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.273971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 215/428] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:38.275511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.275995 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.276465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.298043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:38.300169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:38.362107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 214/429] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:38.367523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.387307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 216/430] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:38.391678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:38.411413 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.475462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0040c-8d4a-4165-9d46-cf89c59e69b0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.485258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:38.523615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295cb3-4448-49f9-914e-14cada6b594e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.527459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.528342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.528620 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.528888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] PATH_INFO: `/v3/projects/a1754e4951234624ac0ae407c871458f` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.530096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] RBAC: Authorizing `identity:get_project(project_id=a1754e4951234624ac0ae407c871458f)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:38.531570 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:38.538440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 215/431] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/projects/a1754e4951234624ac0ae407c871458f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:38.540305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.567538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.568273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.568558 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.568834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.586451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:38.594148 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:38.595106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:38.600615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 217/432] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:38.603564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.656419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:38.675094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f347a-2e31-409a-a2e9-8abdce9d7d31 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.712411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b6550-7397-41b3-afcd-49c884c3a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.713314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b6550-7397-41b3-afcd-49c884c3a43a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.713739 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b6550-7397-41b3-afcd-49c884c3a43a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.714148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b6550-7397-41b3-afcd-49c884c3a43a None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.714367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72a1d3-7d9f-459f-a150-8500f914ae0e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.716335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b6550-7397-41b3-afcd-49c884c3a43a None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:38.717997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b6550-7397-41b3-afcd-49c884c3a43a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:38.724727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 216/433] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:38.726144 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f6f5-bd20-49be-b11c-2b754c490a6b None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.726676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f6f5-bd20-49be-b11c-2b754c490a6b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.727098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f6f5-bd20-49be-b11c-2b754c490a6b None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.728598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 217/434] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:38.729294 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997f6f5-bd20-49be-b11c-2b754c490a6b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.747525 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:38.756073 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.756699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.756983 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.761235 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.761235 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] RBAC: Adding query filter params (name=member) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:38.761235 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:38.761235 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e31b-da84-47d8-9f64-b46995a76810 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:38.773067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 218/435] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:38.773067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.773067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.773067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.791122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:38.792563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:38.848148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997f6f5-bd20-49be-b11c-2b754c490a6b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:38.878304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 219/436] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:38.878304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.892503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:38.893242 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:38.893524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:38.893795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:38.894642 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=a1754e4951234624ac0ae407c871458f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:38.894952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:38.896597 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:38.905039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 218/437] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=a1754e4951234624ac0ae407c871458f&role.id=def5a58760984080ab8717cb294b3f64 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:38.906252 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:38.940214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.012087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cad59-66db-4397-8dda-fb23b309138d None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.038685 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.055949 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f6e0e-7280-46a2-9331-752043b25b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.056583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6e0e-7280-46a2-9331-752043b25b71 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.056864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6e0e-7280-46a2-9331-752043b25b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.057140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6e0e-7280-46a2-9331-752043b25b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.061169 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74051b92-b1ec-42e9-a309-d3d4613167d4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.103990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3ba5-a4c5-4a01-9dbb-1fdc15abb812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.104646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3ba5-a4c5-4a01-9dbb-1fdc15abb812 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.104929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3ba5-a4c5-4a01-9dbb-1fdc15abb812 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.105203 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3ba5-a4c5-4a01-9dbb-1fdc15abb812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.118914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3ba5-a4c5-4a01-9dbb-1fdc15abb812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-d93c3ba5-a4c5-4a01-9dbb-1fdc15abb812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:39.125440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:39.126396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:39.127577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 219/438] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:39.128255 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf131a5-23db-43db-8d47-97f80760fb19 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.129740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf131a5-23db-43db-8d47-97f80760fb19 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.130023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf131a5-23db-43db-8d47-97f80760fb19 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.132610 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 220/439] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:39.136092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf131a5-23db-43db-8d47-97f80760fb19 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.150046 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6e0e-7280-46a2-9331-752043b25b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.152595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6e0e-7280-46a2-9331-752043b25b71 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.234994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.260426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf131a5-23db-43db-8d47-97f80760fb19 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.274528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 220/440] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:39.275731 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.276028 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.276312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.296027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:39.297329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:39.305669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.306767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.306767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.306953 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.309178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:39.309178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.311738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.315414 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.320358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 221/441] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:39.321012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.382237 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 221/442] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:39.384407 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.451760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d01b0-9986-4d5c-a023-e330bb88d47b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.492619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.493188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.493474 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.493756 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.494977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.496440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.503395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 222/443] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:39.503395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.515122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.516299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79ba0-ab3d-4660-ac8b-d20209b564da None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.551528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.552150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.552433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.552710 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.571641 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.606510 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45342646-0f81-4f96-a84f-916dc24866ab None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.621240 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.622730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.640835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.641483 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.641763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.642036 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.652854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:39.658275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:39.659356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 223/444] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.728182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.728780 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 222/445] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:39.729611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.765792 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c9eb3-7f1a-4470-9559-15117842231b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.781986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.799839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.800559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.800900 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.802448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.802681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.803918 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.805497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 224/446] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:39.806255 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.836902 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3027a-57bd-4279-9ce5-1b7036f92610 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.870691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.871559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.871840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.872112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.872821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:39.873119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.874520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.882481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 223/447] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:39.883252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.904822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298299f9-db03-4613-9519-746da1f6a561 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.937686 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:39.938351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:39.938631 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:39.938905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] PATH_INFO: `/v3/projects/153dbedcd8164a2ea26cebf124ccb842` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:39.940044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] RBAC: Authorizing `identity:get_project(project_id=153dbedcd8164a2ea26cebf124ccb842)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:39.941457 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:39.947551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 225/448] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/projects/153dbedcd8164a2ea26cebf124ccb842 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:39.947551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:39.948313 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:39.980997 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f8eb-d763-4beb-abaf-46f8a375d17c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:39.993802 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:40.015776 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.016428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.016648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.016919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.017694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=def5a58760984080ab8717cb294b3f64, scope.project.id=153dbedcd8164a2ea26cebf124ccb842) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:40.018000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.019462 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.025228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 224/449] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=def5a58760984080ab8717cb294b3f64 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:40.025831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:40.065592 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8c3d-4933-4c9f-93e6-d95ffb208237 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:40.106554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.107490 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.107767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.108043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.144750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc822cfe-7573-47cb-921c-56cf226bcd93 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:40.187202 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.188193 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.188652 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.188754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.189223 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] PATH_INFO: `/v3/groups/afbceab8fecc42de9b7a48864aa64f5d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.190252 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.190834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] RBAC: Authorizing `identity:get_group(group_id=afbceab8fecc42de9b7a48864aa64f5d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.192448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.192587 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:40.195198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 225/450] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:40 2022] GET /identity/v3/groups/afbceab8fecc42de9b7a48864aa64f5d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:40.201708 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:40.258067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:40.321027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 226/451] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:40.325052 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51f440-e6eb-4ff9-981f-6a292a7c1392 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:40.327105 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:40.367749 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.368427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.368716 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.368992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.369785 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] RBAC: Adding query filter params (group.id=afbceab8fecc42de9b7a48864aa64f5d, role.id=75ed1976f12e48b38908f23e51856c1e, scope.project.id=153dbedcd8164a2ea26cebf124ccb842) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:40.370095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.372323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.378979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 226/452] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:40 2022] GET /identity/v3/role_assignments?group.id=afbceab8fecc42de9b7a48864aa64f5d&scope.project.id=153dbedcd8164a2ea26cebf124ccb842&role.id=75ed1976f12e48b38908f23e51856c1e => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:40.450437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc674d-3b21-4069-8b39-b22acb4fd1ea None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:40.452269 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:40.491598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.493392 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.493972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.494971 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] PATH_INFO: `/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.497351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] RBAC: Authorizing `identity:get_project(project_id=4fb3fc79734a41949ef7b41a3d86f9ef)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.498857 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.500567 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 227/453] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 23:02:40 2022] GET /identity/v3/projects/4fb3fc79734a41949ef7b41a3d86f9ef => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:40.506501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:40.616740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101ed78-05dd-43af-8385-4f95b360a800 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:40.626560 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:40.651375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d480547-5943-4fa4-994e-24fc1ed85d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.652316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d480547-5943-4fa4-994e-24fc1ed85d7d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.652595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d480547-5943-4fa4-994e-24fc1ed85d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.652871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d480547-5943-4fa4-994e-24fc1ed85d7d None admin] PATH_INFO: `/v3/groups/7726e1ddfb814c9d8703c7599f162d71` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.654140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d480547-5943-4fa4-994e-24fc1ed85d7d None admin] RBAC: Authorizing `identity:get_group(group_id=7726e1ddfb814c9d8703c7599f162d71)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.655638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d480547-5943-4fa4-994e-24fc1ed85d7d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.657241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 227/454] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 23:02:40 2022] GET /identity/v3/groups/7726e1ddfb814c9d8703c7599f162d71 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:40.663373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:40.767805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97110-b6aa-4345-a98e-e22cf54e8bfd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:40.801355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:40.802004 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:40.802302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:40.802581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:40.803356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] RBAC: Adding query filter params (group.id=7726e1ddfb814c9d8703c7599f162d71, role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=4fb3fc79734a41949ef7b41a3d86f9ef) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:40.803662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:40.805076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c97c-d725-421a-97bb-7c23ba19d208 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:40.810879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 228/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 23:02:40 2022] GET /identity/v3/role_assignments?group.id=7726e1ddfb814c9d8703c7599f162d71&scope.project.id=4fb3fc79734a41949ef7b41a3d86f9ef&role.id=b808049b0af24ba79f7b5a53a732242d => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:43.365132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930a31-ab5c-4952-b83c-63de051e9906 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.366108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930a31-ab5c-4952-b83c-63de051e9906 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.366612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930a31-ab5c-4952-b83c-63de051e9906 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.368435 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 228/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:43.375239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894a1a-ec0a-458e-957a-d47edd4d4c1f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.376083 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894a1a-ec0a-458e-957a-d47edd4d4c1f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.376569 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894a1a-ec0a-458e-957a-d47edd4d4c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.395778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-11894a1a-ec0a-458e-957a-d47edd4d4c1f None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:43.397282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-11894a1a-ec0a-458e-957a-d47edd4d4c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:43.426611 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:43.474586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 229/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:43.477814 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1942-c835-47a1-ace5-59d2df66f11f None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.478103 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1942-c835-47a1-ace5-59d2df66f11f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.478419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1942-c835-47a1-ace5-59d2df66f11f None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.479985 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 229/458] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:43.485665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.485963 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.486238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.504287 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1942-c835-47a1-ace5-59d2df66f11f None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:43.505531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:43.506763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:43.606770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 230/459] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:43.626846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:43.641422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1942-c835-47a1-ace5-59d2df66f11f None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:43.679424 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:43.680421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.680919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.681384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.695266 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:43.697715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-22e3426c-d31a-433a-98c4-923a27ffcc05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:43.715009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:43.721221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 230/460] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6495778-f17a-49c6-a108-ff767bbbe4d7 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6495778-f17a-49c6-a108-ff767bbbe4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6495778-f17a-49c6-a108-ff767bbbe4d7 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.722084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 231/461] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:43.722598 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6495778-f17a-49c6-a108-ff767bbbe4d7 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:43.738665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:43.745266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c41d-18d9-4cc2-b90f-1908952f3e6d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:43.757112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:43.783791 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:43.784491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.784750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.785032 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.797515 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:43.799034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-ac953551-b994-49b4-bdf2-e038fa1e5c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:43.814820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:43.815745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:43.816681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:43.816681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:43.816681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:43.816681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:43.816681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 231/462] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:43.817313 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.817600 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.817877 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.837768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:43.839029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:43.854729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6495778-f17a-49c6-a108-ff767bbbe4d7 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:43.894477 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:43.895013 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:43.895294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:43.895567 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:43.896259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:43.896561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:43.897946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:43.915122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 232/463] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:43.915297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 232/464] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:43.916607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:43.918766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:43.997788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.019801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.020249 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61225b1-8fb4-407c-b416-ab22d9f49b93 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.032583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60f929-6802-4700-8056-ed30a0b40f34 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.056311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52694b0-ee79-4e87-9829-2e9a06bd288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.056937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52694b0-ee79-4e87-9829-2e9a06bd288a None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.057215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52694b0-ee79-4e87-9829-2e9a06bd288a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.057508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52694b0-ee79-4e87-9829-2e9a06bd288a None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.058260 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52694b0-ee79-4e87-9829-2e9a06bd288a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.060051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52694b0-ee79-4e87-9829-2e9a06bd288a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.066900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.067520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.067798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.068074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.068759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:44.069061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.070586 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.082081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 233/465] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:44.082896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.145904 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 233/466] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:43 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:02:44.147161 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19329c12-7f66-49cc-8c27-180200088218 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.147458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19329c12-7f66-49cc-8c27-180200088218 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.147781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19329c12-7f66-49cc-8c27-180200088218 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.149026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 234/467] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:44.149738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19329c12-7f66-49cc-8c27-180200088218 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.196720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960250-9c76-4adb-8c92-5b515fcf6c65 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.235140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.236128 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.236484 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.236837 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.249942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.251719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.260728 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-c3732f8f-433b-40dc-999b-412ecaff2cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:44.268994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:44.276077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:44.277775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:44.277775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:44.277775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:44.277775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:44.277987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19329c12-7f66-49cc-8c27-180200088218 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.278059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 234/468] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:44.278761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.278761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.278919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.298533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:44.299757 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:44.309970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.315777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.316410 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.316687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.316951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.317713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.319257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.378097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 235/469] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:44.379557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.391495 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 235/470] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:44 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:44.407459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.519160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cd327-61f9-43b6-a0b3-6f86748f15f9 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.537407 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a82da1-9f79-488d-bcf2-b38a2d5bb260 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.552974 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.561447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.562094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.566191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.566191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.566191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:44.566191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.566191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.581794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 236/471] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:44.586345 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.586345 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.586547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.592062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.596683 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.602390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.604923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:44.623653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:44.624590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:44.625439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:44.625439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:44.625439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:44.625439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:44.625649 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 236/472] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:44.631114 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.679883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.733780 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898363fd-3595-4957-ab95-45ec1e92fd98 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.747980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fc3c3-8547-4a65-a92d-fa1947ab6356 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.770460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933632a0-2bd7-40a0-a544-38acf84d979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.771094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933632a0-2bd7-40a0-a544-38acf84d979c None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.771375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933632a0-2bd7-40a0-a544-38acf84d979c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.771646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933632a0-2bd7-40a0-a544-38acf84d979c None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.772619 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933632a0-2bd7-40a0-a544-38acf84d979c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.774301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933632a0-2bd7-40a0-a544-38acf84d979c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.785571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.786641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.787238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.787783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.788697 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:44.789297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.790986 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:44.805737 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 237/473] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:44.812431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:44.878619 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 237/474] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:44 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:02:44.919984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:44.923337 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c490b5-9b86-4f5e-a597-14d36203c9fd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:44.962613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214451ed-d7f5-4401-8e87-4fca59668576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:44.963427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214451ed-d7f5-4401-8e87-4fca59668576 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:44.963816 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214451ed-d7f5-4401-8e87-4fca59668576 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:44.964197 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214451ed-d7f5-4401-8e87-4fca59668576 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:44.965755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214451ed-d7f5-4401-8e87-4fca59668576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:44.967376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214451ed-d7f5-4401-8e87-4fca59668576 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:45.052902 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 238/475] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:02:44 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:02:46.522132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120fa1-7834-4bfa-b65b-51142570dfd8 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:46.522673 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120fa1-7834-4bfa-b65b-51142570dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:46.522861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120fa1-7834-4bfa-b65b-51142570dfd8 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:46.524318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 238/476] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:46.530702 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f8e1-8efa-44f7-96cd-4264882e1010 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:46.531101 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f8e1-8efa-44f7-96cd-4264882e1010 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:46.531271 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f8e1-8efa-44f7-96cd-4264882e1010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:46.549289 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7c48f8e1-8efa-44f7-96cd-4264882e1010 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:46.550499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7c48f8e1-8efa-44f7-96cd-4264882e1010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:46.627524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 239/477] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:46.652299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120fa1-7834-4bfa-b65b-51142570dfd8 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:46.704566 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:46.764312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120fa1-7834-4bfa-b65b-51142570dfd8 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:46.801937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a619ee-bf67-4f36-9beb-d4aca9908702 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:46.802143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a619ee-bf67-4f36-9beb-d4aca9908702 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:46.802451 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a619ee-bf67-4f36-9beb-d4aca9908702 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:46.802561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:46.803372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:46.803782 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:46.804031 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 240/478] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:46.804316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:46.809417 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:46.809706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:46.809987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:46.816793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:46.822617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:46.823699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:46.825153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:46.827505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 239/479] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:46.829738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:46.834430 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:46.834589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:46.922459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 241/480] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:46.942037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:46.958505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6859e63-a6b2-4811-bbaf-44cb7ac5b284 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:46.960673 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:46.967657 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:46.997129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:46.997859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:46.998214 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:46.998592 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.000831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:47.001217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.003037 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.015953 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 240/481] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:47.021400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.061700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7055384-e223-4938-857e-88c464e4cd96 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.107962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.108651 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.108937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.109219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.125819 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:47.132458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:47.133458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:47.134254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:47.138386 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 242/482] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:47.140952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.147354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee15ede-8190-4b9d-bfe8-e94430cf15f1 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.185620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.186271 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.186594 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.186869 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.201239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.203841 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:47.223254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:47.224166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:47.225034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:47.225034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:47.225034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:47.225034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:47.227397 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 241/483] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:47.235918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.244730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:47.271884 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:47.279077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac78a-652d-496d-95e5-9e01b1e27e17 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.416017 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.416711 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.416987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.417261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.418651 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:47.418962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.420324 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3a89-92b3-47d8-a6c3-b8ced878a199 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.428500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 243/484] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:47.429502 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20885c-9af3-4462-a75b-4be816cf830e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.429784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20885c-9af3-4462-a75b-4be816cf830e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.430157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20885c-9af3-4462-a75b-4be816cf830e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.435742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 244/485] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:47.436863 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34dd2f-be21-436d-a5b9-33ebd7d3d085 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.437144 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34dd2f-be21-436d-a5b9-33ebd7d3d085 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.437418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34dd2f-be21-436d-a5b9-33ebd7d3d085 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.438654 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 245/486] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:47.439336 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34dd2f-be21-436d-a5b9-33ebd7d3d085 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.455178 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72970a68-ed09-4dc0-95e9-aa697c187624 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.489267 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.489880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.490162 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.490461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.491144 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:47.491444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.492797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cecb8-6b68-4517-93f3-98333752ec2a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.505524 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 242/487] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:47.506939 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf50cfc-ef3d-4d9e-8b26-d77b69b9e3b6 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.507382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf50cfc-ef3d-4d9e-8b26-d77b69b9e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.507659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf50cfc-ef3d-4d9e-8b26-d77b69b9e3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.525177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-eaf50cfc-ef3d-4d9e-8b26-d77b69b9e3b6 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:47.526641 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-eaf50cfc-ef3d-4d9e-8b26-d77b69b9e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:47.546455 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34dd2f-be21-436d-a5b9-33ebd7d3d085 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.581394 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.582062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.582370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.582644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.591175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:47.595520 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.596958 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.599190 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 243/488] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:47.600638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.600946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.601357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:47.614065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:47.615136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:47.616176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:47.616176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:47.616176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:47.616176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:47.617039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 246/489] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:47.617974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.625890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:47.629776 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:47.630489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:47.694952 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 244/490] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:47.696177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.731936 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8940e-4f96-4cb8-a37a-6eeb5ea176aa None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.766155 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.766816 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.767096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.767371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.774636 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.776117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:47.789384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:47.790331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:47.791240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 247/491] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:47.791815 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.804679 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979317-950c-4da8-99cc-b12ee238fd18 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.841474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.841852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:47.842090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.842400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.842679 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.843375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:47.843675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:47.845048 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:47.853121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:47.857146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 245/492] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:47.858910 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.893676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bdcff-8a9c-47ad-9f83-be5790537b28 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.927858 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.928491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.928772 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.929045 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:47.939146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:47.944441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:47.945554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:47.946462 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 248/493] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:47.947138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:47.963023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0c802-c845-4492-8d4d-91174400ae19 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:47.997932 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:47.998600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:47.998880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:47.999154 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.009151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:48.014405 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:48.015302 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:48.016100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 246/494] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:48.016765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.046929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff678d0-c29b-4ec5-b05a-28fc04e1f51f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.057216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.080093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.081365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.082162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.082616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.083160 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.083951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:48.084256 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.085741 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.120627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2d9b8-ce65-4483-be51-6d583b7c3fd7 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.123496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 249/495] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 23:02:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:48.124325 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.162738 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.163371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.163651 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.163925 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] PATH_INFO: `/v3/users/glance` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.172015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.173464 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:48.187041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:48.193957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 247/496] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:48.194919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.227093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c336596-caf8-4f7e-a204-c78483b3f893 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.264616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.265244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.265965 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.266248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.266989 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:48.267556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.268872 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.278808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 250/497] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:48.278808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.290098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5741-677f-4836-b7a2-05b66888fcbc None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.309367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.311135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.324529 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.325146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.325427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.325697 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.328224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:48.328224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.328224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.336241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 248/498] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:48.337014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.378271 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bf0af-128c-4a3e-b989-7e94b031eac9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.411030 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.411653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.411935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.412210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.435798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140e62-f8eb-4cf8-9830-250da46a3b5d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.469428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.470037 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.470341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.470632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.471436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:48.471747 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.473158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.479035 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.481038 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.510163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.511059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 249/499] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:48.512119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.554451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.583016 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 251/500] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:48.583853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.616196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd608-4d02-4167-8c33-f93afc8eed48 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.649748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.650419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.650703 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.650980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.661514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.663023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:48.677682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:48.678714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:48.679537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:48.679537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:48.679537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:48.679537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:48.679537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 250/501] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:48.679805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.689215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ca15-4a26-4705-a674-2680a09c535a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.717850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.723403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.724089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.724371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.724641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.734504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.735894 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:48.751023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:48.752055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:48.753121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:48.753121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:48.753121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:48.753121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:48.753121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 252/502] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:48.753121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.774015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.782827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14345e-0145-4651-b597-d0ebd973208c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.817839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.818486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.818770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.819049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.853791 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62db20-40d4-4385-895c-2540366ef362 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:48.888381 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:48.889022 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:48.889304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:48.889402 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.889581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:48.890841 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.900011 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:48.901701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:48.915955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:48.916912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:48.918472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:48.918472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:48.918472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:48.918472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:48.918472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 253/503] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:48.918472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:48.955408 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.986119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:48.995114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 251/504] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:48.996062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.025656 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650f01-b935-438c-b39c-99d6693a37e7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.059273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.059880 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.060163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.060447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.061131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.061437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.062842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.079242 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 254/505] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.079242 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.101297 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450685e-b3a4-4696-b1a4-68e9e9a5b61e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.134629 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.135246 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.135522 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.135792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.137010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.137309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.138762 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.150125 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 252/506] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.150944 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.170692 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.176759 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db36254-6f37-4a41-92f3-3d0310d95fa0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.203787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.210685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.211307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.211590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.211867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.213411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.213411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.214175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.225786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 255/507] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.226613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.256386 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429079de-8554-4fbf-80dc-a0db2b3d7124 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.291199 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.291921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.292198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.292530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.302896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.304384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:49.318809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:49.319669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:49.320518 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:49.320518 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:49.320518 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:49.320518 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:49.320518 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 253/508] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:49.320791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.330783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc90c-2a13-4beb-94d0-e803612a64db None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.364903 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.365544 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.365828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.366103 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.373465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.374957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:49.385951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:49.387524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 256/509] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:49.388586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.404588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.424298 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3751a-d2b3-49d0-8052-732607b6b356 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.426608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.459059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.459707 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.459991 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.460268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.469316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.470802 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:49.482159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:49.483080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:49.483951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 254/510] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:49.484511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.491622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1b0de-8d84-4dd1-9998-02f1027e62e4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.526182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.527223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.527593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.528053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.535058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.536518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:49.548500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:49.549444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:49.550735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 257/511] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:49.551512 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.588928 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b276b7-5f74-4baa-9e8c-a4720f9e913c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.624574 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.625185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.625463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.625735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.626452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.626750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.628108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.636901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.640186 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 255/512] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.641004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.665215 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.666404 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba92fb-9642-4e02-b8da-8a34f3ebf0fe None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.700745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.701365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.701644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.701914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.702727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.703032 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.704455 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.722304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 258/513] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.723115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.740334 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55696214-153e-431e-a3ab-9e8148a44d86 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.774122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.774766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.775040 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.775307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.776083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.776686 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.778591 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.796417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 256/514] 10.222.0.48 () {56 vars in 1139 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.797207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.822218 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4407-bc3f-4c62-b377-75cac63749c6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.853585 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.859522 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.860143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.860423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.860699 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.861440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:49.861743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.863189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.881034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:49.886355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 259/515] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:49.887177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.899754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4726c-04d2-40d1-a263-600d03d3b05f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:49.936052 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:49.936690 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:49.936976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:49.937259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:49.943931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:49.945384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:49.958358 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:49.959226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:49.960068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 257/516] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:49.961050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:49.990008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d9420-d447-479d-9d3a-c31e3f701742 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.025006 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.025628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.025939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.026195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.060053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2e632-efcc-48e1-b4b5-6717dbb448b3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.087883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.093502 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.094122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.094434 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.094718 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.097172 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.098676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.106481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.163122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.164570 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.197265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 260/517] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:50.198103 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.267574 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 258/518] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:50.268421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.294984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.303511 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ab988-f70b-4fc2-a0d8-ef996a645392 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.310885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.339382 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.339994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.340273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.341160 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.342043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=4a37e53e47a342e197a1826fff5ede73) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:50.342380 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.343818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.349083 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 261/519] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/role_assignments?user.id=4a37e53e47a342e197a1826fff5ede73&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:50.349849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.366685 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49016a5-367c-462b-8eeb-fcda508a3c9e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.411188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.411831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.412112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.412390 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.413172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:50.413482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.415003 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.440523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 259/520] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:50.441278 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.469307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969d35-b2b7-4c43-90dc-3e6a1348eec3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.507839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.508791 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.509173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.509541 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.525536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.527305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:50.551653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:50.558411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:50.559299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:50.559299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:50.559299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:50.559299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:50.559299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 262/521] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:50.559299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.560174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c9b4c-a423-4480-9cd9-e69594c27376 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.561983 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.569090 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.601360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.602007 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.602316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.602583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.615939 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.617818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:50.638398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:50.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:50.640150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:50.640150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:50.640150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:50.640150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:50.642928 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 260/522] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:50.644264 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.668327 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b97c88-245d-4795-8ba6-64709f7d5988 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.708996 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.709954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.710484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.710899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.711834 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=b422d3c782ae4b86a3af62a83b2a6489) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:50.712424 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.713983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.726487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 263/523] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/role_assignments?user.id=b422d3c782ae4b86a3af62a83b2a6489&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:50.727657 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.769322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6dfea-5a54-4e69-946b-186c226101d4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.816811 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.817674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.818110 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.818573 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.819433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:50.819912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.821563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.833179 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.836524 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 261/524] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:50.843131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.860097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:50.875680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa7abc-e0ad-44d8-bde8-c944197a9f0a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:50.923643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:50.924630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:50.925228 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:50.925728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:50.926727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:50.927233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:50.928907 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:50.947639 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 264/525] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:50.949409 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:50.964598 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c1879-2d85-4fe7-bfa3-9cbd8e40efc4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.008316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.008961 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.009252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.009512 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.019697 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.021607 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:51.037420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:51.038699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:51.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:51.041989 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 262/526] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:51.049674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:51.073260 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb30a1b-dc86-412b-a5c5-699b782b4d71 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.108375 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:51.114944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.115843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.121775 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.121775 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.124704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.126530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:51.139637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:51.140516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:51.141357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:51.141909 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:51.143327 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 265/527] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:51.149176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:51.181537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00519d46-fa95-4f8a-9537-6c88aebb68e5 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.227523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.228206 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.228491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.228820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.230141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:51.230622 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.232594 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:51.248537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 263/528] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:51.255253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:51.284363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb09b4-7cf9-44ed-bc31-5f1e92943a87 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.333187 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.334479 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.334967 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.335556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.337136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:51.337650 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.339632 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:51.355945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 266/529] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:51.362303 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:51.380694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830981c-7078-468e-bf09-46dcced77ae4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.416999 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.417944 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.418434 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.419059 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.420049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=240ff8f23838441aa25ca1cf766c7014) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:51.420541 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.421192 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:51.422438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29a03-3d36-4cc7-9f04-a4e88e8cc79a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:51.424685 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:51.429648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 264/530] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:51 2022] GET /identity/v3/role_assignments?user.id=240ff8f23838441aa25ca1cf766c7014&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:51.485743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b927eb-54d1-4204-ad67-d9ad55a21879 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:51.528937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:51.529950 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:51.530486 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:51.530970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:51.532030 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=95dab827e0eb4f28a7fb0fa414a4bb9b) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:51.532588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:51.534410 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9b09-9f36-4fa3-be21-66193795bf46 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:51.541453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 267/531] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:02:51 2022] GET /identity/v3/role_assignments?user.id=95dab827e0eb4f28a7fb0fa414a4bb9b&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:52.626759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f1c3e-688f-45ea-95c9-8ec7e13fde5e None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:52.627375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f1c3e-688f-45ea-95c9-8ec7e13fde5e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:52.627375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f1c3e-688f-45ea-95c9-8ec7e13fde5e None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:52.628796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 265/532] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:52.634726 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:52.635685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:52.636178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:52.658040 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:52.659591 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:52.732244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 268/533] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:52.756415 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f1c3e-688f-45ea-95c9-8ec7e13fde5e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:52.869930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f1c3e-688f-45ea-95c9-8ec7e13fde5e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:52.918004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0daffd-0486-4fb0-a6af-bff05b21cf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:52.919156 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0daffd-0486-4fb0-a6af-bff05b21cf20 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:52.919504 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0daffd-0486-4fb0-a6af-bff05b21cf20 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:52.919850 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0daffd-0486-4fb0-a6af-bff05b21cf20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:52.932340 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0daffd-0486-4fb0-a6af-bff05b21cf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-af0daffd-0486-4fb0-a6af-bff05b21cf20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:52.938474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:52.939497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:52.940354 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 266/534] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:52.947785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:52.997240 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.053375 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c303eac-3d96-4089-a8cc-efed8b5489a4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.089674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4f2fb-3d11-4014-ac9f-4feedd18a743 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.089995 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4f2fb-3d11-4014-ac9f-4feedd18a743 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.090110 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.090213 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4f2fb-3d11-4014-ac9f-4feedd18a743 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.091189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.091476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.091725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.092381 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:53.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 267/535] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:02:53.092749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.098335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.098488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.098488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.098488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.103161 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 269/536] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:53.108822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.130486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:53.130486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:53.204623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.223947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 268/537] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:53.226983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259100-685b-4177-ba94-3c9e16d61f4d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.239683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.247681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.266735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.267484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.267822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.268102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.282195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.283823 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:53.300219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:53.301309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:53.302387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:53.302387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:53.302387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:53.302387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:53.302387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 270/538] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:53.307480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.358765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee794a2-b6fa-47be-afd4-a16da04f46f2 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.400196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.400978 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.401323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.401922 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.413884 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:53.420107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:53.421015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:53.421798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 269/539] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:53.429977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56de994-4fdf-45fc-a626-9edfbb76d439 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.430275 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.483076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.483772 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.484053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.484384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.485717 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:53.486480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.488320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.497180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.514358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 271/540] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:53.519032 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.550116 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.564217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5733984-8e2d-4272-b19a-a4665f27dd43 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.612447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.613104 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.613382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.613656 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.614403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:53.614707 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.616072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.629775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 270/541] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:53.631070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.662983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d27191-d89c-4a8d-8e1e-d5f608096797 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.700402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.701412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.701692 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.701964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.709411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.710863 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:53.723059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:53.724005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:53.724912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 272/542] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:53.731362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.757021 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42855692-217b-4383-b6af-008dc94c4741 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.769611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.797239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.797969 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.798257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.798582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.816048 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.817561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-7f258de9-4d1a-4a3f-9737-285724943fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:53.835106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:53.836027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 271/543] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d091d-91a3-4925-af8d-c0790fed9286 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d091d-91a3-4925-af8d-c0790fed9286 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d091d-91a3-4925-af8d-c0790fed9286 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.842517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 272/544] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:53.843006 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d091d-91a3-4925-af8d-c0790fed9286 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:53.851316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:53.872809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893249c-9a5f-4d03-839d-970eb4cf7ba0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.909191 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.909845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.910475 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.910991 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.911834 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:53.912842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.914340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b76e7-75a4-420e-8142-b0b8bce8346b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:53.937137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 273/545] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:53.937137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3084-25a2-4820-af89-af9ad6e91b3a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.937137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3084-25a2-4820-af89-af9ad6e91b3a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.937137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e3084-25a2-4820-af89-af9ad6e91b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.953242 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-ba6e3084-25a2-4820-af89-af9ad6e91b3a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:53.954453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-ba6e3084-25a2-4820-af89-af9ad6e91b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:53.958820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d091d-91a3-4925-af8d-c0790fed9286 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:53.994894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:53.995516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:53.995821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:53.996097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:53.997372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:53.997675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:53.999078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.010586 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 273/546] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:54.011559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.022369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 274/547] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:54.023620 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486234e-c6ba-444f-8c10-86d13facba1c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.023910 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486234e-c6ba-444f-8c10-86d13facba1c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.024188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486234e-c6ba-444f-8c10-86d13facba1c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.025424 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 275/548] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:54.026115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486234e-c6ba-444f-8c10-86d13facba1c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.039862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.098822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.114860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878219e6-dd87-49b7-af9c-7811b0751ea9 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.132428 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486234e-c6ba-444f-8c10-86d13facba1c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.149759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.150444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.150726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.151005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.161367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.162851 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.167043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.167626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.167899 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.168165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] PATH_INFO: `/v3/users/glance` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.176388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.177829 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-95c03ac4-606c-4964-90f7-3c3a4d11bd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:54.178520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:54.179490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:54.180341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:54.180341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:54.180341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:54.180341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:54.180341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 274/549] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:54.181150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868e240-5043-4935-98cd-45c74aed732a None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.181433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868e240-5043-4935-98cd-45c74aed732a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.181710 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868e240-5043-4935-98cd-45c74aed732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:54.194831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:54.195859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 276/550] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:54.197358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.199519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-2868e240-5043-4935-98cd-45c74aed732a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:54.203761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-2868e240-5043-4935-98cd-45c74aed732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:54.270147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 275/551] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:54.270931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868e240-5043-4935-98cd-45c74aed732a None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.274672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.319147 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b79c-09fc-4dd7-aefc-39d8cf48e73a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.345787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.354220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.358793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.358793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.358793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.366469 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:54.371267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:54.373034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:54.373867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 277/552] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:54.374748 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.380873 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868e240-5043-4935-98cd-45c74aed732a None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.414898 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.415516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.415821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.416099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.416797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:54.417151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.418627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.429656 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 276/553] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:54.430476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.478238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16df749-09e0-4ed4-bc7b-de4ac4c0d4ee None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.490894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.514162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.514923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.515212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.515518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.516309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:54.516616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.518037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.532584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90636c5d-30e4-4827-be33-9f0bfbeb8016 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.535641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 278/554] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:54.536441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.567170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.567818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.568098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.568368 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.579417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:54.584693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:54.585684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:54.586976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 277/555] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:54.587662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.597427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.651674 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fd643-76fa-41a6-abef-2879ac748501 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.686674 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.687291 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.687560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.687828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.688018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02b28f-8238-49e6-9086-3c706b561cce None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.688535 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:54.688835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.690314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.697975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 279/556] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:54.698798 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.716166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.726550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.729299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.729299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.729299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.736510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.736510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:54.748818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:54.749911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:54.750839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 278/557] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:54.751332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.807423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7fd71-ac45-4de8-b9e9-55d730641d82 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.816785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.841018 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.841657 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.841940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.842216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.850972 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351ad0-138a-47eb-a5fc-0c6e5b94bb4d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:54.853296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.854864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:54.869460 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:54.870932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:54.872461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:54.872461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:54.872461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:54.872461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:54.872461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 280/558] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:54.872461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.889044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:54.889672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:54.889956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:54.890234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:54.891120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:54.891422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:54.892799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:54.901040 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 279/559] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:54.902090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:54.949896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:54.975574 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7fc25-261f-4918-9669-7e4a2e0b8a3a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.004477 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ba38-b833-48e7-adcb-52a1db944df0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.010200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.010879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.011163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.011449 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.022472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.023939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:55.038261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:55.039442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:55.040332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:55.040332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:55.040332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:55.040332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:55.040565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.040565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.040565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.040565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.041263 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:55.041561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.043024 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.044624 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 281/560] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:55.045351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.055689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 280/561] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:55.056501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.061293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.146687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ae6e0-9fde-483c-ada8-2b3beda3dfba None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.158958 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d34e-05fa-43f9-8595-1fa92c8d9325 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.166254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.180226 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.180853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.181134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.181517 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.182217 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:55.182553 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.184446 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.192781 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.193417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.193696 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.193968 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.196605 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 282/562] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:55.197178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.205692 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.208061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:55.225101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:55.227856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:55.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:55.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:55.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:55.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:55.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 281/563] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:55.228990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.270442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.299748 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24b0ba-70ee-4af1-ae3e-0ffcb6dcbde8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.329467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340e12f-bb9f-478b-8d21-310e0d77d81f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.333545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.334163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.334472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.334749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.335437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:55.335739 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.337098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.348707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 283/564] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:55.349495 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.365933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.366641 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.366923 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.367203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/4a37e53e47a342e197a1826fff5ede73/roles/a3ed697fe45143698b5b7d9c06ff2396` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.382113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=4a37e53e47a342e197a1826fff5ede73, role_id=a3ed697fe45143698b5b7d9c06ff2396)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.385408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.448962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970f6a-52c1-4c39-a293-7de21c9362d4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.478354 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.479667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 282/565] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:55 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/4a37e53e47a342e197a1826fff5ede73/roles/a3ed697fe45143698b5b7d9c06ff2396 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:55.480554 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.493102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.493660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.493941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.494102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.494233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.502755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.504526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:55.517738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:55.519551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 284/566] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:55.520441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.609522 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7757-14b5-46fe-8baf-e88cfa67dc27 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.646595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a376-fe9b-4063-834c-972a49a1a905 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.661566 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.662308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.667160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.667160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.667160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:55.667160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.667160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.677922 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 283/567] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:55.678795 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.686855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.690840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.690840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.690840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.697259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.698913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:55.711304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:55.723604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 285/568] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:55.724696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.759165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.775621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:55.796550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28e570-aab6-458d-996d-907cd17472af None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.829144 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7694f9e-5a54-4d40-a1a4-a1b36b954eda None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.831470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.832105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.832393 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.832675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.833425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:55.833735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.835199 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.852301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 284/569] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:55.852301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.869048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:55.869810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:55.870092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:55.870395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:55.879205 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:55.880629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:55.892665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:55.893626 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:02:55.894729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:55.898488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 286/570] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:55.899422 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:55.963350 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad2442-5a08-4861-a5a6-85610aaca4ad None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:55.994961 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.003330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.004031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.004240 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.009452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.009452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:56.009452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.009452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.015656 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5e0ac-a88f-48cd-b25e-d89983c49af0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.025954 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 285/571] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 23:02:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:56.027083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.035188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.058261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.059469 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.059868 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.060148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/b422d3c782ae4b86a3af62a83b2a6489/roles/a3ed697fe45143698b5b7d9c06ff2396` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.076239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=b422d3c782ae4b86a3af62a83b2a6489, role_id=a3ed697fe45143698b5b7d9c06ff2396)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.077904 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.130866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e906d6-cf45-4882-bb0d-7d9503421004 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.144643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 287/572] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:55 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/b422d3c782ae4b86a3af62a83b2a6489/roles/a3ed697fe45143698b5b7d9c06ff2396 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:56.145740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.179873 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.180766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.181116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.181461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.182565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:56.183016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.184785 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.206672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 286/573] 10.222.0.48 () {56 vars in 1139 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:56.211803 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.268551 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.306010 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b0147-e285-4a54-8520-809bed1f2b62 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.331906 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a0c3-f5ae-4536-a568-5980b189cd80 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.358480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.359728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.360642 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.361069 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.373466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.374257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.374648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.374996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.376647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.378974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.387679 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.389114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:56.407154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:56.408079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:56.409129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:56.409129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:56.409129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:56.409129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:56.409129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 288/574] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:56.409416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:56.410640 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:56.411720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:56.411720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:56.411720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:56.411720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:56.411720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 287/575] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:56.415411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.415614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.433761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.517752 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.524003 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252c6d-9a6c-4509-bd5e-1f52f075962c None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.534585 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7a64-6565-480a-b34e-7503b76668f0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.561272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.562034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.562355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.562637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.563328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:56.563674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.565723 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.573363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.574246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.575264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.577361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.577361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:56.577361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.579672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.581930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 288/576] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:56.590805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.605604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 289/577] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:56.614306 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.722720 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.733410 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcffc7-da70-4214-886f-2486b53ea5ef None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.753749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362b9a5-aa9b-41c7-8ab5-81a517d36bc4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.802664 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.804155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.805031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.805457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.815885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.816805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.817580 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.817910 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.818039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.818428 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.826568 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.828124 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:56.832292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:56.833294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:56.834195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:56.836910 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 289/578] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:02:56.843402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:56.844304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:02:56.848782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:56.849245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.849407 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 290/579] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:56.849407 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:56.865311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:56.949861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3eb3-febe-4a03-9386-4340a196ec57 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.964193 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02e86-5500-41dc-8579-ec50232bd040 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:56.985367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:56.986105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:56.986487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:56.986830 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:56.987659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:56.988486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:56.990351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:57.003870 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901785de-2364-4c20-b334-cc21450de867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:57.004763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901785de-2364-4c20-b334-cc21450de867 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:57.005273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901785de-2364-4c20-b334-cc21450de867 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:57.005737 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901785de-2364-4c20-b334-cc21450de867 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:57.006746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 290/580] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:57.006964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901785de-2364-4c20-b334-cc21450de867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:57.007278 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901785de-2364-4c20-b334-cc21450de867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:57.008850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901785de-2364-4c20-b334-cc21450de867 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:57.010690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:57.013388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:57.026598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 291/581] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:57.035446 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901785de-2364-4c20-b334-cc21450de867 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:57.098799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:57.123089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2daa-879d-41e0-967f-e4c2bfb8e180 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:57.140264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901785de-2364-4c20-b334-cc21450de867 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:57.159825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51544-bd12-40f7-b8bb-168dea8f6c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:57.160486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51544-bd12-40f7-b8bb-168dea8f6c75 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:57.160768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51544-bd12-40f7-b8bb-168dea8f6c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:57.161044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51544-bd12-40f7-b8bb-168dea8f6c75 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/240ff8f23838441aa25ca1cf766c7014/roles/a3ed697fe45143698b5b7d9c06ff2396` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:57.177363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51544-bd12-40f7-b8bb-168dea8f6c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=240ff8f23838441aa25ca1cf766c7014, role_id=a3ed697fe45143698b5b7d9c06ff2396)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:57.178089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a150f9-ac03-4351-91b9-0c5e2e7d6cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:57.178835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51544-bd12-40f7-b8bb-168dea8f6c75 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:57.179256 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a150f9-ac03-4351-91b9-0c5e2e7d6cd5 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:57.179755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a150f9-ac03-4351-91b9-0c5e2e7d6cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:57.180256 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a150f9-ac03-4351-91b9-0c5e2e7d6cd5 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/95dab827e0eb4f28a7fb0fa414a4bb9b/roles/a3ed697fe45143698b5b7d9c06ff2396` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:57.196264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a150f9-ac03-4351-91b9-0c5e2e7d6cd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=95dab827e0eb4f28a7fb0fa414a4bb9b, role_id=a3ed697fe45143698b5b7d9c06ff2396)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:57.197931 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a150f9-ac03-4351-91b9-0c5e2e7d6cd5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:57.271794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 291/582] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:57 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/240ff8f23838441aa25ca1cf766c7014/roles/a3ed697fe45143698b5b7d9c06ff2396 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:02:57.287065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 292/583] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:02:57 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/95dab827e0eb4f28a7fb0fa414a4bb9b/roles/a3ed697fe45143698b5b7d9c06ff2396 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:02:57.843841 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028428f-10a1-4e70-a237-d1f7ba3a4ca5 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:57.844335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028428f-10a1-4e70-a237-d1f7ba3a4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:57.844335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028428f-10a1-4e70-a237-d1f7ba3a4ca5 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:57.845929 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 292/584] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:57.851184 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:57.851583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:57.851751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:57.871095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:57.872896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:57.920168 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:57.947933 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 293/585] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:57.974762 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028428f-10a1-4e70-a237-d1f7ba3a4ca5 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.088875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028428f-10a1-4e70-a237-d1f7ba3a4ca5 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:58.119045 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:58.128359 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:58.129252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.129682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.130107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.142840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:58.148672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:58.154478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:58.155501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 293/586] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:58.158322 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.270645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb08ff5-18a3-4c72-aef5-0e697de48d90 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:58.307575 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:58.308253 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.308550 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.308850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.309627 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:58.310058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:58.311516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:58.320127 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 294/587] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:58.325462 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.442719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e5798-9b1d-48d0-8acb-7a6a4536ced7 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:58.482467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:58.483392 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.483833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.484263 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.495686 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:58.497447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-7ca22926-9e1b-480f-99bd-e2df376ac31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:58.513476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:58.514563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:58.515650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:58.515650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:58.515650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:58.515650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:58.517501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 294/588] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:58.523420 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.563362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:58.599355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60cda-44e7-4460-9e51-666268b6fba7 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.599652 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60cda-44e7-4460-9e51-666268b6fba7 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.599918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60cda-44e7-4460-9e51-666268b6fba7 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.601264 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 295/589] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:58.606662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.607069 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.607627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.630669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:58.632011 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:58.649785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6cde8-f354-4261-ad72-425d0a44b0ad None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:58.670796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:58.686839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:58.687757 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.688188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.688640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.689487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:58.690183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:58.691728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:58.705107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 295/590] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:58.716810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.722446 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 296/591] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:02:58.747041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.827054 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:58.833624 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f3b6d-23fd-4ea9-bd61-0599b4fd84d7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:58.856925 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3489e-269c-43b0-a1ba-10f32af312ec None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:58.871380 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:58.872019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.872306 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.872707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.880545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:58.882104 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:58.894809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:58.900136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:58.901231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 296/592] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:02:58.903985 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.904790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:58.905650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:58.906092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:58.906559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:58.921412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:02:58.928542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:58.930693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:02:58.931766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:58.939359 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 297/593] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:58.940370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:58.973480 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.039124 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c78a30-db13-44cc-9a60-7171cceeb656 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.053456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b53be-2948-4309-8cdd-da4ab9678ffd None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.077604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.078811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.079244 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.079844 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.081129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:59.081866 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.084052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.092034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.092802 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.093182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.093556 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.094408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:59.094814 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.097118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.109953 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 298/594] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:02:59.112750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.113176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 297/595] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 23:02:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:59.114023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.131285 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.210689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.221108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ceedc-ec53-4f0e-8303-ab7063bdee49 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.223381 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5582fd-b220-4766-8cfa-d66a926ea017 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.256662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.257278 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.257567 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.257940 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.261029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.261813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.262448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.262896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.269970 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.271482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:59.287377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:59.288509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:59.289601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:59.289601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:59.289601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:59.289601 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:59.293988 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 299/596] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:59.294838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.342685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.344463 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.360635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.399703 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef9a9-f087-4ed5-bd4f-9a881a770344 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.435948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.436717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.437004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.437283 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.438031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:59.438383 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.439753 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.457594 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 300/598] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:59.457841 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 298/598] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:02:59.458495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.459050 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.482658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.583329 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2bc3d-40f6-4ba8-b2b5-eb0d47a114a1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.594719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddec2-671a-4289-bd53-d6b61d81edc6 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.601065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.627087 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.628107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.628684 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.629314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.643045 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.645084 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.645733 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.646438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.646723 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.647002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.658805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.660318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:02:59.664426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:59.665292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:59.666182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:02:59.666182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:02:59.666182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:02:59.666182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:02:59.672820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 299/599] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:02:59.673417 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:02:59.674375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:02:59.675421 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:02:59.677017 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.678411 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 301/600] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:02:59.680773 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.756373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.793334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040fef1-87d6-4c02-bcef-32afd4adf9e8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.796268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6069f0-1b75-4fe6-b171-8d6639c12205 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.827758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.828382 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.828666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.828940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.829629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:59.829936 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.830473 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.831096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.831333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b5ef9-1d99-4b52-bb73-ea6be2ad8a74 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.831423 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.831639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.832429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:02:59.832736 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.834221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203133-070b-4e57-8071-f311b5a2cb0e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:59.843017 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 300/601] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:59.844041 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bf913-681f-4018-8b8f-ebcd3d4ad0ed None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.844327 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bf913-681f-4018-8b8f-ebcd3d4ad0ed None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.844601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bf913-681f-4018-8b8f-ebcd3d4ad0ed None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.845806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 301/602] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:59.846841 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d8ab-1f6f-433e-9465-955b1486e12d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.847126 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d8ab-1f6f-433e-9465-955b1486e12d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.847480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d8ab-1f6f-433e-9465-955b1486e12d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.848584 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 302/603] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:02:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:02:59.849272 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d8ab-1f6f-433e-9465-955b1486e12d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:59.857883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 302/604] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:02:59.859211 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee8c1-8a06-4610-a495-928b13b02fa2 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.859483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee8c1-8a06-4610-a495-928b13b02fa2 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.859758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee8c1-8a06-4610-a495-928b13b02fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.877480 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-047ee8c1-8a06-4610-a495-928b13b02fa2 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:59.878554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:59.878997 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-047ee8c1-8a06-4610-a495-928b13b02fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:59.945646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 303/605] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:02:59.946930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.947228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.947501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.952538 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d8ab-1f6f-433e-9465-955b1486e12d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:59.965290 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:02:59.966519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:02:59.987297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:59.987929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:59.988340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:59.988614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:59.995032 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:59.996998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:00.008302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:00.009234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 303/606] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:00.015922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.016467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.034319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 304/607] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:03:00.035182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.116681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.131908 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aa2a-1780-43c4-bc2b-6add8bc50b7a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.134433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a349-91f3-4a38-b7c5-4b5480c38abb None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.166117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.166762 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.167038 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.167311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.170915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.172388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.172669 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.172942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.183143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:03:00.188859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:00.189855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:00.190722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 305/608] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:00.191693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.231860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.239298 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.246024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.289112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860fa3c-1efe-487a-9067-0c164e1e82a3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.323179 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.323528 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.323787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.324077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.324380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.325081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:00.325377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.326834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.339149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 304/609] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:03:00.339983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.340658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 306/610] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:00.341963 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.456138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.459256 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ffb4-3873-46ee-9181-69d4e91d69bc None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.463701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e81ce3-ec90-40e4-be5f-722f7b90a6a5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.494429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.495049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.495339 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.495615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.496360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:00.496675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.497746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.498171 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.498426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.498727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.499003 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.505996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 307/611] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:00.506823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.513894 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:03:00.518744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:00.519768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 305/612] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:00.521448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.569620 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.618077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7a8b-f1a3-4ae0-af4a-9824827a10ae None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.631999 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc88a9-0e81-49a7-82e8-dc68568167bb None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.654507 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.655154 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.655436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.655714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.666704 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.668382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:00.685239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:00.686188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:00.687119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:00.687119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:00.687119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:00.687119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:00.687349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.687440 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 308/613] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:00.687510 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.687578 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.687660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.688177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.689291 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=4a37e53e47a342e197a1826fff5ede73) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:00.689603 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.691067 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.698466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 306/614] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/role_assignments?user.id=4a37e53e47a342e197a1826fff5ede73&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:00.699301 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.709458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.824862 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266140-60af-4938-9764-0b2c98ddec99 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.825552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0bf8a-c6cd-47e7-ad12-27a7013da1c4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:00.839576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:00.866257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.867105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.867280 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.867465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.870237 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:00.871481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:00.871958 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:00.872251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:00.872991 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:00.873370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.874814 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.879872 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:00.881511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:00.888292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 307/615] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:00.889903 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:00.898332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:00.899439 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:00.900380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:00.900380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:00.900380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:00.900380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:00.902096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 309/616] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:00.903706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:00.978177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.007154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402950de-a485-4bf0-8ccb-5420caacc525 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.020452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55169776-7dc6-4e20-9adc-8926cee5515f None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.042362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.042961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.043381 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.043751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.044535 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.044843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.046196 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.057452 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 308/617] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.057994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.058239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.059053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.059332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.059606 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.073829 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.076229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:01.092490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:01.093426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:01.094335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:01.094335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:01.094335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:01.094335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:01.094335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 310/618] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:01.094642 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.099246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.169864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e35b25-d962-4c60-862b-9b763b1aeba2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.202815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd850dc6-eddd-49bd-8057-37113db3edde None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.205191 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.205812 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.206091 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.206387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.207231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.207534 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.208919 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.221881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 309/619] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.222889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.226857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.244886 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.245748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.246919 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.247204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.254841 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.256289 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:01.268204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:01.269157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 311/620] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:01.271039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.329706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.338028 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba058bd0-20b2-4926-9f5c-82e547c34d69 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.375872 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.376505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.376612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc7d4b-5608-4e4a-8aa0-bac835757d15 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.376797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.377066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.377768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.378080 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.379488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.393216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 310/621] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.394420 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.416192 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.416840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.417174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.417456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.425698 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.427188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:03:01.439247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:01.440406 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:01.441458 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 312/622] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:01.442088 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.487170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.506637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd7fa-e13a-4494-9baf-6484cdc81f7a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.543664 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.544308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.544676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.544972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.545702 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.546011 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.547611 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.550622 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f7c1-a75d-4687-8451-fe3aebf96439 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.561520 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 311/623] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.562596 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.578901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.601184 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.601867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.602145 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.602452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.610662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.612081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:03:01.623643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:01.624583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 313/624] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:01.625534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.681234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c649c7-d757-44e6-aabc-e4cf4d1ffb40 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.720954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.721573 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.721866 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.722125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.722939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.723242 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.724666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.737715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.741748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef74490-7d56-4d9d-b310-772e7b8f30c1 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.745223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 312/625] 10.222.0.48 () {56 vars in 1139 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.746311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.777197 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.778449 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.778732 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.779004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.779798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=b422d3c782ae4b86a3af62a83b2a6489) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.780266 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.781561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.789249 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 314/626] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/role_assignments?user.id=b422d3c782ae4b86a3af62a83b2a6489&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.790299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.833826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:01.870786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01486833-443f-4f5e-8332-2e8f7840050e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.910353 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.911805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.912301 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.912786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:01.913833 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:01.914398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:01.916047 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:01.938063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 313/627] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:01.944677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:01.947126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4eaaee-d1a0-4bd8-bb98-c39d5b73629e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:01.986343 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:01.987114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:01.987378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:01.987654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.021555 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.065559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.067362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.067663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7b6b0-4b57-442a-a400-0c38abf0708f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.104022 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.117844 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.118524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.118811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.119088 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.192478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 315/628] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:03:02.193716 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.216238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.217754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.258444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.301484 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def69d2-ff5b-41bf-8c2b-47cc3b5ed4c7 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.339451 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 314/629] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:03:02.345245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.351394 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.352115 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.352464 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.352828 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.365200 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.366864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.384686 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:02.387420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:02.388436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:02.389408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:02.389408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:02.389408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:02.389408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:02.394009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 316/630] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:02.395309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.472982 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ea08-1cea-4732-b82e-7534948bfb8e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.509572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.510691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.511040 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.511496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.525769 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.528664 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.531199 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c23fc-20c1-4746-8827-73f7d1be7922 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.547716 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:02.548102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:02.549846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:02.551308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:02.551308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:02.551308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:02.551308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:02.551308 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 315/631] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:02.556195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.579068 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.579702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.580244 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.580526 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.581625 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:02.581934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.583376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.610168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 317/632] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:02.611549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.667849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.689363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e9fe8-7d47-4a3c-b8ba-e17e54cec560 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.727755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.728380 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.728657 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.728928 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.729630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:02.729907 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.732260 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.749790 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 316/633] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:02.751159 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.755963 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d804-e63b-4491-831c-8aee929fd0ab None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.803890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.805211 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.805694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.806195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.818041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.820562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:02.835557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:02.836501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:02.837399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:02.845339 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 318/634] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:02.846031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:02.877008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b92ab-3ae1-49e2-b338-818a1cdeae6e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.882892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.929187 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:02.930640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:02.931849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:02.932329 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:02.942817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:02.944904 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:02.949477 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:02.960614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2e923-634c-47ce-a58c-17c55e6158d2 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:02.964118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:02.973338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:02.974259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 317/635] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:02.975690 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:03.007834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.008563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.008976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.009348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.010311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:03.010924 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:03.012768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:03.032494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 319/636] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:03.033588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:03.112676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4577-19a6-45e5-9efe-8a1831004802 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:03.135712 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:03.144311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c5cd9-42bb-4420-825a-f4a06bb177ac None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:03.150252 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.150925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.151207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.151735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.152578 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:03.153411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:03.154867 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e620-0ecf-49cd-97ac-a8135a671247 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:03.168015 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 318/637] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:03.169099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5644b3c-5956-426d-a0b6-8114fcb7b295 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.169419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5644b3c-5956-426d-a0b6-8114fcb7b295 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.169651 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5644b3c-5956-426d-a0b6-8114fcb7b295 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.171019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 319/638] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:03.175687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5644b3c-5956-426d-a0b6-8114fcb7b295 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:03.188435 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.189157 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.189437 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.189711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.190529 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=95dab827e0eb4f28a7fb0fa414a4bb9b) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:03.190836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:03.192519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5adaf-0c51-4b6a-b2b0-85760e0ea59d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:03.207759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 320/639] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:03:03 2022] GET /identity/v3/role_assignments?user.id=95dab827e0eb4f28a7fb0fa414a4bb9b&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:03.207759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.207759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.207759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.222343 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:03.223833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:03.263905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:03.310790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 321/640] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:03:03.323634 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5644b3c-5956-426d-a0b6-8114fcb7b295 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:03.333309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:03.372376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.373345 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.374058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.375555 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.376579 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=240ff8f23838441aa25ca1cf766c7014) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:03.377089 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:03.378790 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:03.388472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 320/641] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:03:03 2022] GET /identity/v3/role_assignments?user.id=240ff8f23838441aa25ca1cf766c7014&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:03.441753 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:03.456138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ef21a-5601-4b76-9133-1e2405fe7885 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:03.494977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.495646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.495926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.496728 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.509103 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:03:03.514819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:03.520508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:03.522074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 322/642] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:03.522865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:03.657935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784dd1e-3bdb-4f6e-800f-b9271e2d2db0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:03.689294 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:03.701166 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.701793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.706456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.706456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.706456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:03.706456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:03.706456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:03.714461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 321/643] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:03.720231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:03.832885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251863f-62fe-44fd-ac3e-03e75867b307 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:03.871259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:03.872565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:03.873075 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:03.873548 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:03.884724 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:03.886481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:03.902177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:03.904173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:03.905134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:03.905134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:03.905134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:03.905134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:03.909818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:03.910360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 323/644] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:03.919929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.025603 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf043-9ece-41fa-8cec-20948bf4114e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.063132 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.063757 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.064040 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.064318 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.065015 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:04.065319 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.066718 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06072bfd-2109-40c2-ba53-4e3169699acf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.079945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 322/645] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:04.085467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.208029 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735092b5-a6e0-4e6a-8f3a-85601e4ed142 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.248478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.249507 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.250000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.250491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.261214 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.264422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.265498 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239925dd-f8a3-4a6b-be07-f651b3eff9fb None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.265790 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239925dd-f8a3-4a6b-be07-f651b3eff9fb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.266096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239925dd-f8a3-4a6b-be07-f651b3eff9fb None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.267672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 323/646] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:04.272635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.272935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.273195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:03:04.288333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:04.289348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:03:04.290316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:04.292354 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:04.298225 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:04.298551 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 324/647] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:04.300013 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.338373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:04.364325 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:04.370448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 324/648] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:03:04.390717 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.424729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7514f-8717-4dc1-9e19-e13249454802 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.474515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.476078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.476667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.477141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.478155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:04.478689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.481114 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.505494 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf246-0d7c-4a59-9662-f9694287d17a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.505902 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 325/649] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:04.507367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.540663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.541348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.541644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.542068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] PATH_INFO: `/v3/services/image` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.542682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.545074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:04.557162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:04.558254 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:04.559939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 325/650] 10.222.0.48 () {56 vars in 1105 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:04.564614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.616223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:04.628966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b56767-439b-4197-ac3c-84bfe71a6f81 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.648842 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:04.668836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.670085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.670688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.671188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.683886 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437f5b3-c5f7-49d6-8683-60bf85d43d5a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.726431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.726960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.727267 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.727542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.728219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] RBAC: Adding query filter params (name=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:04.728526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.729926 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.740608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 326/651] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:04.741777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:04.768429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.770930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.851952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d58e8-9873-4095-8268-476fe05cdbf4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:04.854376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:04.890024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:04.890689 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:04.890957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:04.891235 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:04.892042 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] RBAC: Adding query filter params (type=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:04.892951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:04.895014 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:04.909874 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 327/653] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:04.910299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 326/653] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:03:04.911897 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:05.042525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dde66-29fc-4466-b3af-ad9873f8a17b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:05.080280 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:05.080944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.081229 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.081505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.094148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:05.095685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:05.112307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:05.113317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:05.120801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:05.120801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:05.120801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:05.120801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:05.120801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 328/654] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:05.121129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:05.143925 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:05.236955 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea73e2-328c-442d-a71a-038a07d41562 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:05.278675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:05.279751 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.280291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.280771 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.281681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:05.282181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:05.283775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:05.297866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 327/655] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:05.306420 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:05.330864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:05.425570 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4c7de-f6ed-489b-87fd-cb8f286d6914 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:05.471093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:05.471795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.472079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.472355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.479660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:05.481660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:05.493342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:05.495074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:05.496785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 329/656] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:05.501446 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:05.594656 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:05.613277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22153d3-047f-42ae-916d-c53bc94f1b48 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:05.648998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:05.649635 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.649927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.650205 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.651008 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:05.651588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:05.653641 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e06fc1-fbac-469d-81d6-316c06bfa524 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:05.668545 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 328/657] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:05.675316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:05.775261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:05.798598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dab87-ed18-4aa7-a841-3c75e21aa03e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:05.825054 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223192-2109-45e7-9095-95b852d90dd4 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.825377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223192-2109-45e7-9095-95b852d90dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.825611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223192-2109-45e7-9095-95b852d90dd4 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.827255 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 329/658] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:05.834259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfead8-fb4b-4204-b39d-1df515b3307c None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.834638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfead8-fb4b-4204-b39d-1df515b3307c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.837182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfead8-fb4b-4204-b39d-1df515b3307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.840384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:05.841012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.841296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.841572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.842403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=4a37e53e47a342e197a1826fff5ede73) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:05.842723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:05.844222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:05.850085 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 330/659] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:03:05 2022] GET /identity/v3/role_assignments?user.id=4a37e53e47a342e197a1826fff5ede73&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=b808049b0af24ba79f7b5a53a732242d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:05.856533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-13dfead8-fb4b-4204-b39d-1df515b3307c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:05.857832 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-13dfead8-fb4b-4204-b39d-1df515b3307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:05.943432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 330/660] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:03:05.971646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:05.985929 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0807a-504b-4352-aad7-6132d97ac72e None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.986229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0807a-504b-4352-aad7-6132d97ac72e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.986526 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0807a-504b-4352-aad7-6132d97ac72e None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:05.988106 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 331/661] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:03:05.995016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:05.995335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:05.995574 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.016828 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:06.018064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:06.094007 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:06.095095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27862-3a50-495a-9f88-3a4e17bb0fea None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:06.103460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 332/662] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:03:06.127879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:06.138726 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:06.139589 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:06.139950 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:06.140301 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] PATH_INFO: `/v3/services/network` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.141113 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:06.142655 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:06.157839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:06.159051 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:06.159888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:06.160719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 331/663] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:05 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:06.167524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:06.202709 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:06.247748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7e9fb-6174-4999-920d-c7ec028ee028 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:06.284247 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b5ce2-aaab-4094-9ab0-d1206e980803 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:06.288202 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:06.288768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:06.289052 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:06.289331 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.289970 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:06.291386 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:06.304108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:06.305127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:06.305994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:06.310692 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 333/664] 10.222.0.48 () {56 vars in 1129 bytes} [Mon Jul 25 23:03:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:06.311573 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:06.326890 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:06.327737 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:06.328163 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:06.328604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.329476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] RBAC: Adding query filter params (name=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:06.329921 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:06.331567 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:06.336755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 332/665] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:06.342645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:06.383154 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:06.429936 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b766b-88bb-4e38-93f2-ca829818fa2a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:06.438665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:06.451645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29a4a-38fc-4e03-babc-e4adca5c06ff None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:06.466800 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:06.467210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:06.467491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:06.467767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.468523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:06.468759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:06.470168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:06.479587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 334/666] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 23:03:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:06.481129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:06.490328 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:06.491314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:06.491796 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:06.492363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.493266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] RBAC: Adding query filter params (type=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:06.493764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:06.495384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad13a85-9cf6-44b0-bb6d-6758c26b7788 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:06.510409 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 333/667] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:06.598241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5cdbb-168d-43b1-a59e-31c900c02c15 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:06.627568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:06.639595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:06.639595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:06.639595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:06.639966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:06.640562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:06.640866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:06.642254 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f992381-0458-442e-b1f4-682cab47b1f8 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:06.648992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 335/668] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 23:03:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:07.399948 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548c87-7270-4604-ac99-4d7cd38d9cd0 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:07.400497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548c87-7270-4604-ac99-4d7cd38d9cd0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:07.400497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548c87-7270-4604-ac99-4d7cd38d9cd0 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:07.402688 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 334/669] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:07.407918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb418ba-f296-47d4-8085-3962d771dd75 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:07.408313 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb418ba-f296-47d4-8085-3962d771dd75 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:07.408475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb418ba-f296-47d4-8085-3962d771dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:07.426967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-aeb418ba-f296-47d4-8085-3962d771dd75 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:07.428163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-aeb418ba-f296-47d4-8085-3962d771dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:07.499360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 336/670] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:03:07.523164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548c87-7270-4604-ac99-4d7cd38d9cd0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:07.639436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548c87-7270-4604-ac99-4d7cd38d9cd0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:07.675019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347d07-3c95-4a0d-a809-966e81aed3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:07.675622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347d07-3c95-4a0d-a809-966e81aed3ca None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:07.675906 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347d07-3c95-4a0d-a809-966e81aed3ca None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:07.676182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347d07-3c95-4a0d-a809-966e81aed3ca None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:07.676889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd347d07-3c95-4a0d-a809-966e81aed3ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:07.678314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd347d07-3c95-4a0d-a809-966e81aed3ca None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:07.686641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:07.782412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 335/671] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:03:07 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:08.249899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08a5f2-7806-43e4-b9c1-3b9e92ed8558 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.250300 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08a5f2-7806-43e4-b9c1-3b9e92ed8558 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.250523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08a5f2-7806-43e4-b9c1-3b9e92ed8558 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.252136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 337/672] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:08.257487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.257783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.258062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.278033 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:08.279279 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:08.374405 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 336/673] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:08 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:03:08.398348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08a5f2-7806-43e4-b9c1-3b9e92ed8558 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:08.507196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08a5f2-7806-43e4-b9c1-3b9e92ed8558 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:08.528794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:08.544798 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:08.547105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.547105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.547105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.556929 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:03:08.562789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:08.563761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:08.565034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 338/674] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:08.571916 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:08.683140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de712e07-3896-4846-8c70-c616e58b59bb None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:08.711536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:08.724484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:08.725440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.725895 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.726369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.727333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:08.727821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:08.729381 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b2734-5ac9-4f9c-8540-e76d3057bacb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:08.742393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 337/675] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:08.747561 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:08.846844 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74dd83-332c-4bae-bc7c-29fa90a03b48 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.847481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74dd83-332c-4bae-bc7c-29fa90a03b48 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.848142 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74dd83-332c-4bae-bc7c-29fa90a03b48 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.850725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 338/676] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:08.857766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.858726 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.859766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.862438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d5fca-7992-4cf1-84bb-cd71a46369f6 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:08.886112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:08.889077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:08.904521 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:08.905199 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:08.905476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:08.905750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:08.916562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:08.918618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:08.934273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:08.935225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:08.936132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:08.936132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:08.936132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:08.936132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:08.938435 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 339/677] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:08.941298 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:08.984220 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:08.986575 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 339/678] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:08 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:03:09.009745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.065809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc6d5a-2abc-4795-9d72-7568fa200198 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.104056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.104596 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.104988 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.105301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.106029 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:09.106451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.107909 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c41c1b-cac8-4754-9665-637a5cc324ae None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.126746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 340/679] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:09.126955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba99913-4ca4-4ac6-b321-8ced166df426 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.127056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5724b-c284-454d-b0a9-2440a409f058 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.127056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5724b-c284-454d-b0a9-2440a409f058 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.127056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5724b-c284-454d-b0a9-2440a409f058 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.127056 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 341/680] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:09.128592 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5724b-c284-454d-b0a9-2440a409f058 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.144401 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:09.166914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f457fc-309d-47cd-9fa1-326dd80bebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.167851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f457fc-309d-47cd-9fa1-326dd80bebd4 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.168136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f457fc-309d-47cd-9fa1-326dd80bebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.168427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f457fc-309d-47cd-9fa1-326dd80bebd4 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.169304 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f457fc-309d-47cd-9fa1-326dd80bebd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.170728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f457fc-309d-47cd-9fa1-326dd80bebd4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.224125 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:09.232023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 340/681] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:03:09 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:09.233292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.233581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.233851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.239304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5724b-c284-454d-b0a9-2440a409f058 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.263982 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:09.266806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:09.282433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.283095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.283372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.283646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.292005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.294051 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:03:09.307207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:09.308330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:03:09.309353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:09.313976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 342/682] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 23:03:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:09.315031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.361447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 341/683] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:09 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:03:09.391608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.463771 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6618-9269-4a6f-bccb-f803153dae42 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.499886 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.500519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.500799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.501073 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.501877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:09.502185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.503743 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.508403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fcdcf-f9cc-41b0-b4e0-1be2e7b2064d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.511189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:09.524735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 23:03:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:09.534109 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.540173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:09.546595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.547222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.547500 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.547774 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.548465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.549849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.622372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 342/685] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:03:09 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:09.661971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082526-e513-491f-9d3e-78c9deeba1cb None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.712487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.713147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.713428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.713706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.726870 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.728347 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:09.745015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:09.746702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:09.748400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:09.748400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:09.748400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:09.748400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:09.748400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:09.752466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.874532 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff69ae-5fcd-4196-84f6-b1b8f191df6c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:09.912525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:09.913148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:09.913425 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:09.913687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:09.914422 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:09.914726 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:09.916095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:09.929365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 343/687] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:09.934917 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:09.993777 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:10.047739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784801f8-5993-48cc-8195-0bb4c29a12ea None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:10.083021 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:10.083673 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.083954 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.084230 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.092132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:10.093571 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-f372b6fe-1767-4784-a5f8-8c0610016c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:10.105486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:10.106466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:10.107367 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 345/688] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:10.112832 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:10.141173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:10.180927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d47c-cf83-4a92-8e28-45033f864283 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.181537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d47c-cf83-4a92-8e28-45033f864283 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.181537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d47c-cf83-4a92-8e28-45033f864283 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.183061 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 346/689] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:10.191040 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.191606 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.192104 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.215020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:10.217304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:10.222983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa4219-f256-4174-84a5-c93f580b2d68 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:10.270599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:10.271238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.271519 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.271793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.272572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:10.273270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:10.275005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:10.292446 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 344/690] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:10.301422 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:10.305294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 347/691] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:03:10.335111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:10.383492 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:10.397821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:10.415403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daa9cc-4e3d-4c38-a2d2-c81c632fdac3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:10.441516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821e29-0b8b-4df4-bfc6-26ea87b08f94 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:10.454572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:10.455257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.455634 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.455913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/4a37e53e47a342e197a1826fff5ede73/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.457997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=4a37e53e47a342e197a1826fff5ede73, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:10.459671 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:10.478191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:10.478876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.479156 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.479431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] PATH_INFO: `/v3/services/image` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.480095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:10.482016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:10.491265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:10.492615 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:10.493472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 348/692] 10.222.0.48 () {56 vars in 1105 bytes} [Mon Jul 25 23:03:10 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:10.498659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:10.534342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 345/693] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:03:10 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/4a37e53e47a342e197a1826fff5ede73/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:03:10.629658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6737a68-0b9e-437f-abd2-25ab284b34bd None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:10.641627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:10.671503 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:10.672475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.672963 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.673466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.674419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] RBAC: Adding query filter params (name=image) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:10.676013 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:10.677747 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:10.684316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 349/694] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:10.690011 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:10.808125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60124822-6e7d-4d7a-9167-50ee02393528 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:10.847297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:10.848197 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:10.848637 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:10.849068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:10.849884 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] RBAC: Adding query filter params (type=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:10.850393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:10.851879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:10.858678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 346/695] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:10.864424 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:10.976564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e804dd-db40-4b28-8faa-b36738a87398 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:11.013543 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:11.014164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:11.014476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:11.014757 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:11.015508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] RBAC: Adding query filter params (interface=public, service_id=1b5ba2fe254141468de59e872a39fe75, region_id=RegionOne) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:11.015815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:11.017177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bd164-0948-471f-b5d7-a678418e04c6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:11.030408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 350/696] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:03:10 2022] GET /identity/v3/endpoints?service_id=1b5ba2fe254141468de59e872a39fe75&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:11.035560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:11.049268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:11.151677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9aa6-e6dc-41d3-a941-6ec3b686a372 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:11.188581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2675ef3-e874-40d9-80bb-a9fdaa184dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:11.189594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2675ef3-e874-40d9-80bb-a9fdaa184dbc None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:11.190106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2675ef3-e874-40d9-80bb-a9fdaa184dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:11.190612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2675ef3-e874-40d9-80bb-a9fdaa184dbc None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:11.191465 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2675ef3-e874-40d9-80bb-a9fdaa184dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:11.193021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2675ef3-e874-40d9-80bb-a9fdaa184dbc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:11.199959 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 347/697] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:03:11 2022] GET /identity/v3/services => generated 1002 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:11.655806 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3af2-c6e6-461d-a17a-1ba2d983bd39 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:11.656317 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3af2-c6e6-461d-a17a-1ba2d983bd39 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:11.656395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3af2-c6e6-461d-a17a-1ba2d983bd39 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:11.657987 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 351/698] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:11.663177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:11.663466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:11.663743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:11.683134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:11.684635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:11.757869 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 348/699] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:11.782946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3af2-c6e6-461d-a17a-1ba2d983bd39 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:11.821997 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:11.892779 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3af2-c6e6-461d-a17a-1ba2d983bd39 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:11.928689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:11.929335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:11.929613 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:11.929883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] PATH_INFO: `/v3/services/network` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:11.930547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:11.931998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-7d447516-a691-4b73-a3ac-5ef0850a78ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:11.942366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:11.943433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:11.944277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 352/700] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:11 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:11.950330 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:11.952848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:12.060594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3077c5-524e-4b17-b823-038b06ee7f80 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.097562 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.098187 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.098497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.098771 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.099513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] RBAC: Adding query filter params (name=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:12.099814 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.101227 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.107236 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 349/701] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:12.112911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b9d6f-519e-49cd-b22d-4693d351696b None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.113201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b9d6f-519e-49cd-b22d-4693d351696b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.113485 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b9d6f-519e-49cd-b22d-4693d351696b None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.115089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 353/702] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:12.115948 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.119946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.120240 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.120522 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.139281 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:12.140475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:12.194569 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:12.222433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 354/703] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:12.239881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a46b-f8a5-4d0f-b064-4caafa77ab14 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.248921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.287634 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.288278 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:12.288556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.288974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.289367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.290058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] RBAC: Adding query filter params (type=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:12.290393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.291749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.308296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 350/704] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:12.310186 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.370092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270f26d-4d88-438f-8358-07109fd0147b None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.411345 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.412674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.412674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.412674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.413132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.414519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:12.424077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:12.425050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:12.425975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:12.430089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 355/705] 10.222.0.48 () {56 vars in 1129 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:12.431038 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.457916 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e0832-87fd-405e-aa53-132e4001ced1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.501748 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:12.509846 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.511224 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.511695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.512974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.513730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] RBAC: Adding query filter params (interface=public, service_id=f9ff87d904a94f7dbc250d80752b29ea, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:12.514193 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.516396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.532758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 351/706] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/endpoints?service_id=f9ff87d904a94f7dbc250d80752b29ea&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:12.533881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.559495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:12.569671 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757e512-1a17-441b-9c2d-cb5eaabfde39 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.615980 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.616810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.616921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.617158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.617879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:12.618169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.619577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.626333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 356/707] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:12.630581 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.679325 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b87e6-18a7-45cd-9cde-254a22046b28 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.722356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.723517 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.723993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.724639 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.725831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.727379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.743029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 352/708] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/services => generated 1002 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:12.750060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720f01-29b4-4b39-841a-62274b140954 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.792833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.793699 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.793981 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.794257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.795016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:12.795322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.796799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b37cb-8cbc-4104-99b6-15e8084baa1b None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.803127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 357/709] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:12.809411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.879595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:12.928294 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88d964-fb11-4d1a-88a6-afc85313f1ef None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:12.940175 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb8f1-f9f9-4b25-808c-13b5ea4f00f9 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.940466 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb8f1-f9f9-4b25-808c-13b5ea4f00f9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.940751 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb8f1-f9f9-4b25-808c-13b5ea4f00f9 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.945943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 358/710] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:03:12.947470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.947753 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.948027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.966723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:12.967353 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:12.967631 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:12.967902 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:12.968653 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] RBAC: Adding query filter params (interface=public, service_id=d0f953d5ccbb4b5aa11087b983aa3550, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:12.968959 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:12.969749 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:12.970320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:12.971155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:12.977162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 353/711] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/endpoints?service_id=d0f953d5ccbb4b5aa11087b983aa3550&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:12.984185 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:12.991641 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:13.062653 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 359/712] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:13.086794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.102571 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361963f4-3672-4663-b7a8-52c287418d2d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.128675 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:13.140768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.141397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.141675 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.141991 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.142695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:13.144394 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:13.150533 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 354/713] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:03:12 2022] GET /identity/v3/services => generated 1002 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:03:13.218432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19503640-4f9a-4f20-a59f-c79b78e5f2f1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.260355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.261324 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.262411 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.262907 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.275317 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:03:13.280891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:13.281896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:03:13.282784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:13.285327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 360/714] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:13.291518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.410528 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450525e-da4a-4b50-9f75-e9305d157a4d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.451453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.452349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.452623 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.452894 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.453605 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:13.453905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:13.455310 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47473f-cc19-45ea-b650-998b758f0dec None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:13.465061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 355/715] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:13.470993 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.487779 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:13.541820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9ac5e-b502-43d2-a62d-fc4ffddd5326 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.542485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9ac5e-b502-43d2-a62d-fc4ffddd5326 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.543219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9ac5e-b502-43d2-a62d-fc4ffddd5326 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.546009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 356/716] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:13.551009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.551293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.551572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.575346 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:13.577576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:13.587810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999e13-3caa-4a49-9f8b-1ee3208fb48e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.625208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.625854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.626135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.626442 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.628778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:13.638143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:13.639681 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:13.656688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:13.658142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:13.659118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:13.659118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:13.659118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:13.659118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:13.660066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 357/717] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:03:13.663695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 361/718] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:13.669988 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.682259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.753346 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:13.778435 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b71aa-cf19-4bce-b7ea-57d4be277492 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.797465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd7a6c-18fa-428a-8a45-7a8b7f81ec33 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.814937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.815593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.815865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.816146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.816843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:13.817147 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:13.818538 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:13.835495 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 358/719] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:13.836411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.837472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.838443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.839092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.839688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] PATH_INFO: `/v3/services/image` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.840631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:13.842264 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:13.852475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:13.853568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:03:13.854455 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:13.862317 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 362/720] 10.222.0.48 () {56 vars in 1105 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:13.863495 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:13.877764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:13.943797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393b1bd-833d-40a2-8305-9d5057fef632 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.974430 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d04829-af60-47da-a97b-f3dcae337e38 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:13.979962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:13.980832 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:13.981116 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:13.981601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:13.990124 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:13.991635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:03:14.005251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:14.006339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:14.007300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 359/721] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:14.010752 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:14.016619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:14.024050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.024050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.024050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.024733 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.025619 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] RBAC: Adding query filter params (name=image) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:14.028117 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.029854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.035603 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 363/722] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:14.041416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:14.118696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:14.122900 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133c52-f29b-4a71-9936-988a4114d3b6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:14.154845 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac3f47-1833-4bd6-ac75-edee60002c8e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:14.159720 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.160492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.160777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.161061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.161855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:14.162162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.164012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.188960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 360/723] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 23:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:14.189876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:14.192817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.193654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.194169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.194675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.195552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] RBAC: Adding query filter params (type=image) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:14.196057 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.197617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.208559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 364/724] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:14.209666 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:14.267329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:14.301842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7929-8dcf-4678-aaaa-8cb41b1a1d3f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:14.315344 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c656-c08d-4a43-b168-dd0812626450 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:14.342794 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.343811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.344265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.344772 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.351440 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.352140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.352508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.352854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.353648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.355371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.379993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:14.421620 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.423716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.454963 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 365/725] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:14.556620 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 361/726] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:03:14 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:03:14.563507 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:14.690342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccaea1-d5d9-4e1f-88de-2a2d61d6fc5a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:14.700937 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:14.728286 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.729198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.729671 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.730306 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.741891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.743577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:14.759146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:14.760792 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:14.762486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:14.762486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:14.762486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:14.762486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:14.764349 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 366/727] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:14.770152 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:14.832647 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:14.880453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7272151-17eb-4d63-9868-1c6aa2c95ddc None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:14.917524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:14.918526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:14.918955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:14.919376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:14.920299 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:14.920750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:14.922296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:14.936071 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 362/728] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:14.941962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.054498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6bbed-0721-430b-8d83-7cb74b22920d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.090368 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.091268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.091697 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.092168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.099647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.101089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-54ecc551-b145-434b-a3cf-5bf7029700b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:15.117767 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:15.125844 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:15.126942 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 367/729] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:15.128577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.152036 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107350be-29f2-43d6-9901-3eda358c781b None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.152252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107350be-29f2-43d6-9901-3eda358c781b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.152659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107350be-29f2-43d6-9901-3eda358c781b None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.154908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 368/730] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:03:15.159539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.159818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.160093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.179002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:15.180195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:15.198820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:15.251993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad38f8-32c9-46da-8c4a-0d2e90e3d5d8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.263863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 369/731] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:15 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:15.272472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:15.288530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.295212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.296124 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.296608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.297141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.298225 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:15.298746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.300511 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.315957 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 363/732] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:15.322209 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.423648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99e7a8-e08b-4c29-a202-df700c1c0499 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.444578 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc4f1-5e60-48ea-ac9e-96ddcc418ea0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.462557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.463472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.463938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.464501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] PATH_INFO: `/v3/services/network` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.465529 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.467250 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:15.477010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:15.477994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:03:15.478880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:15.486367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.486367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.486367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.486367 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.486864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 370/733] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:15.486962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=4a37e53e47a342e197a1826fff5ede73) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:15.487319 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.488375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.488707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631652a-21d7-4204-83b5-ad9d89eff145 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.502390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 364/734] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/role_assignments?user.id=4a37e53e47a342e197a1826fff5ede73&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=b808049b0af24ba79f7b5a53a732242d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:15.510567 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:15.559724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea7fc-7e32-4aea-822c-3a9def873c57 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.560391 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea7fc-7e32-4aea-822c-3a9def873c57 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.560740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea7fc-7e32-4aea-822c-3a9def873c57 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.562525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 365/735] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:03:15.568704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.569323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.569823 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.602738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:15.603982 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:15.624612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09975de2-941f-478f-b794-04ad56ef1cbc None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.646083 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:15.665825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.666511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.666905 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.667273 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.668395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] RBAC: Adding query filter params (name=network) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:15.668934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.670579 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.680064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 371/736] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:15.682709 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.692927 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 366/737] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:15 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:03:15.722379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.790782 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:15.818731 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57033c-6b28-47e5-99f8-e7bc1822bb21 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.857429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.858058 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.858373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.858794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.859095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bf518-d8b3-45cd-bc14-2c77674c61d1 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:15.860077 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] RBAC: Adding query filter params (type=network) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:15.860790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.863110 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.869129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 372/738] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:15.875460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.900504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:15.901396 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:15.902806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:15.903110 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:15.903764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:15.905158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:15.916712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:15.917746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:03:15.918719 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:15.921554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 367/739] 10.222.0.48 () {56 vars in 1129 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:03:15.929441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:15.981238 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:16.003905 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e609-131c-4664-a58c-3d8ff9832fc2 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:16.050369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:16.051468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:16.052240 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:16.052625 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:16.053468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:16.055550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:16.068498 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cf62d-4be0-418f-ab4e-85fee0a176c7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:16.104473 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:16.105741 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:16.106023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:16.106370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:16.107062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:16.107369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:16.110342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:16.114628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 368/740] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 23:03:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:16.119948 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:16.134658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:16.146381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 373/741] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:16.237853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:16.247099 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775faa0c-5f61-486c-93e6-a2170949e7be None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:16.292272 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:16.293868 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:16.294340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:16.294764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:16.295601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:16.296056 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:16.297775 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735c22b-f87f-4ada-8261-47f0b3dac153 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:16.304730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 369/742] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 23:03:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:16.311751 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:16.422101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949773-7aac-4335-ba8c-9c15516bde14 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:16.459290 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0900d4a-72e8-49bb-9672-f660e7dd02ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:16.459926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0900d4a-72e8-49bb-9672-f660e7dd02ec None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:16.460325 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0900d4a-72e8-49bb-9672-f660e7dd02ec None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:16.460608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0900d4a-72e8-49bb-9672-f660e7dd02ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:16.461324 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0900d4a-72e8-49bb-9672-f660e7dd02ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:16.462726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0900d4a-72e8-49bb-9672-f660e7dd02ec None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:16.527670 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 374/743] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:16.880139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8898-bd00-4c2d-a633-9adfaa3510c6 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:16.880676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8898-bd00-4c2d-a633-9adfaa3510c6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:16.880676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8898-bd00-4c2d-a633-9adfaa3510c6 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:16.881982 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 370/744] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:16.887717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879a42-4e11-42c0-9269-8952578c609c None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:16.888109 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879a42-4e11-42c0-9269-8952578c609c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:16.888272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879a42-4e11-42c0-9269-8952578c609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:16.907092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-57879a42-4e11-42c0-9269-8952578c609c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:16.908286 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-57879a42-4e11-42c0-9269-8952578c609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:16.959682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:16.983364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 375/745] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:16 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:17.006924 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8898-bd00-4c2d-a633-9adfaa3510c6 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:17.112714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8898-bd00-4c2d-a633-9adfaa3510c6 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:17.150434 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:17.150991 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:17.151529 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:17.152400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:17.180380 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:17.222779 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:17.224232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:17.324356 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 371/746] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:03:17 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:03:17.330017 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879a42-4e11-42c0-9269-8952578c609c None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:17.429538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879a42-4e11-42c0-9269-8952578c609c None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:17.463787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:17.464278 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:17.464749 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:17.465031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:17.475402 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:17.476835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-2fe45405-9dec-4ad4-820f-3e0848055068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:03:17.492487 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:17.493408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:17.494319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:03:17.494319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:03:17.494319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:03:17.494319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:17.499227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 376/747] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:17.500015 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:17.558879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:17.602922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4536603-d125-49c2-8a5e-85366fa15213 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:17.639745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:17.640362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:17.640638 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:17.640908 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:17.641590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:17.641887 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:17.643256 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611855-b7b6-4933-87c3-48c73766a989 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:17.661961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 372/748] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:17.905817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae732d-f602-454b-b31c-f5d135932366 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:17.906376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae732d-f602-454b-b31c-f5d135932366 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:17.906376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae732d-f602-454b-b31c-f5d135932366 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:17.907863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 377/749] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:17.913203 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:17.913631 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:17.913827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:17.932284 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:17.934019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:18.002411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 373/750] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:17 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:03:18.025796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae732d-f602-454b-b31c-f5d135932366 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:18.060331 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:18.130460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae732d-f602-454b-b31c-f5d135932366 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:18.163556 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:18.164119 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:18.164397 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:18.164668 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:18.165291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:18.166811 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:18.176251 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:18.177364 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:18.178428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:18.182195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 378/751] 10.222.0.48 () {56 vars in 1132 bytes} [Mon Jul 25 23:03:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:18.183783 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:18.233615 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:18.285648 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368eb9bc-0caf-4dc6-b746-cd7b2f876081 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:18.319524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:18.320149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:18.320427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:18.320697 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:18.321370 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:18.321672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:18.323080 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed31f5-038b-45a0-be08-5a1815755bf8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:18.327547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 374/752] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 23:03:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:18.333172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:18.428276 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:18.434663 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c4a09-ede3-4d80-9676-0562bf783faf None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:18.468993 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:18.469611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:18.469893 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:18.470166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:18.470875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:18.471177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:18.472533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee00568-caee-46b4-bed5-02c30a290695 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:18.476867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 379/753] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 23:03:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:18.819351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2296-a8e8-45e2-9052-de8810e1a6b7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:18.819633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2296-a8e8-45e2-9052-de8810e1a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:18.819902 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2296-a8e8-45e2-9052-de8810e1a6b7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:18.821350 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 375/754] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:18.827721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:18.828014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:18.828294 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:18.847042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:18.848232 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:18.915903 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 380/755] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:18 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:18.940584 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c2296-a8e8-45e2-9052-de8810e1a6b7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:19.041935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c2296-a8e8-45e2-9052-de8810e1a6b7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:19.054927 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:19.075421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:19.075990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:19.076264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:19.076531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:19.077141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:19.078518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:19.087590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:19.088594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:19.090027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 376/756] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:19.095705 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:19.185688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:19.195137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8b0a-102c-493b-a485-a05147143eed None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:19.230027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:19.230692 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:19.230973 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:19.231252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:19.231938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:19.232245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:19.233605 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5e7f9-9526-4ee4-b05b-20f3ccaa5d76 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:19.238224 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 381/757] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:19.243863 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:19.344116 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069fc3f-014d-4ea2-82cd-30bb6d6ba267 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:19.376923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:19.377537 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:19.377818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:19.378091 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:19.378797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:19.379100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:19.380456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9fad-b399-4d31-ab1b-f61a951b3930 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:19.384828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 377/758] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:20.720824 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b053e-0279-4eef-822a-6e06da0e8223 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:20.721342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b053e-0279-4eef-822a-6e06da0e8223 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:20.721453 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b053e-0279-4eef-822a-6e06da0e8223 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:20.722751 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 382/759] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:20.728009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9ae1-644b-4362-9413-c4fe5ea07539 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:20.728394 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9ae1-644b-4362-9413-c4fe5ea07539 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:20.728567 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9ae1-644b-4362-9413-c4fe5ea07539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:20.747411 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a49b9ae1-644b-4362-9413-c4fe5ea07539 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:20.748594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a49b9ae1-644b-4362-9413-c4fe5ea07539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:20.783006 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:20.815264 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 378/760] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:20 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:20.839360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b053e-0279-4eef-822a-6e06da0e8223 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:20.939199 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b053e-0279-4eef-822a-6e06da0e8223 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:20.972969 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afec5a-58c8-4a10-a834-90f015d4eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:20.973591 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afec5a-58c8-4a10-a834-90f015d4eede None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:20.973875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afec5a-58c8-4a10-a834-90f015d4eede None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:20.974151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afec5a-58c8-4a10-a834-90f015d4eede None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:20.974891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afec5a-58c8-4a10-a834-90f015d4eede None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:20.976260 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afec5a-58c8-4a10-a834-90f015d4eede None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:21.070583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 383/761] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:03:20 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:21.616635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eac8d6-07d3-41a4-9cb3-e5c62837c5da None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:21.616922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eac8d6-07d3-41a4-9cb3-e5c62837c5da None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:21.617198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eac8d6-07d3-41a4-9cb3-e5c62837c5da None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:21.618641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 379/762] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:21.623923 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36713d8-5ad0-4183-b3fc-da8ca539036a None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:21.624215 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36713d8-5ad0-4183-b3fc-da8ca539036a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:21.624496 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36713d8-5ad0-4183-b3fc-da8ca539036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:21.642253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e36713d8-5ad0-4183-b3fc-da8ca539036a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:21.643537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e36713d8-5ad0-4183-b3fc-da8ca539036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:21.653375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:21.716739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 384/763] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:21 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:21.740737 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eac8d6-07d3-41a4-9cb3-e5c62837c5da None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:21.844763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eac8d6-07d3-41a4-9cb3-e5c62837c5da None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:21.879476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e330da-a0ba-445f-a605-6d6acee294cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:21.880093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e330da-a0ba-445f-a605-6d6acee294cb None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:21.880372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e330da-a0ba-445f-a605-6d6acee294cb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:21.880642 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e330da-a0ba-445f-a605-6d6acee294cb None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:21.881343 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e330da-a0ba-445f-a605-6d6acee294cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:21.882735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e330da-a0ba-445f-a605-6d6acee294cb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:21.977995 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 380/764] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:03:21 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:23.321248 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746799-a727-4529-a18b-b42294cd5554 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:23.321778 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746799-a727-4529-a18b-b42294cd5554 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:23.321867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746799-a727-4529-a18b-b42294cd5554 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:23.323185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 385/765] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:23.329382 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:23.329774 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:23.329984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:23.348442 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:23.349614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:23.375995 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:23.427378 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 381/766] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:23.452328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746799-a727-4529-a18b-b42294cd5554 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:23.551509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746799-a727-4529-a18b-b42294cd5554 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:23.584664 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:23.588090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:23.588090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:23.588090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:23.588090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:23.588090 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:23.599786 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:23.601996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:23.603559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 386/767] 10.222.0.48 () {56 vars in 1132 bytes} [Mon Jul 25 23:03:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:23.613916 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:23.718968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815b0f-ad60-4e29-8daf-e51bed56f7a2 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:23.753069 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:23.753697 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:23.753977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:23.754251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:23.754968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:23.755275 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:23.756631 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:23.762257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 382/768] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 23:03:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:23.767941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:23.771864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:23.872814 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c53d7d-14b0-4753-aaa3-51559df61c41 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:23.905885 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:23.906532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:23.906814 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:23.907096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:23.907769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:23.908069 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:23.909419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:23.914084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 387/769] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 23:03:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:03:23.920389 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:23.942220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:24.018449 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc0e71-1d6b-416c-ad46-9b22ea539313 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:24.052494 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:24.053106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.053384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.053654 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.054443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] RBAC: Adding query filter params (interface=public, service_id=a58fa8c5c93945aabd65d8c07e5f5dd9, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:24.054750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:24.056100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcd89-cf83-4203-a208-6a6d83891e95 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:24.061124 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 383/770] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:03:23 2022] GET /identity/v3/endpoints?service_id=a58fa8c5c93945aabd65d8c07e5f5dd9&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:24.066644 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:24.137492 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:24.172878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f942f0-141b-4630-a64e-bf020a14b387 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:24.206342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e2377-05ed-49e0-a136-ebb06044edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:24.206960 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e2377-05ed-49e0-a136-ebb06044edb9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.207241 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e2377-05ed-49e0-a136-ebb06044edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.207517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e2377-05ed-49e0-a136-ebb06044edb9 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.208163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e2377-05ed-49e0-a136-ebb06044edb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:24.209520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e2377-05ed-49e0-a136-ebb06044edb9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:24.216040 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 388/771] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:03:24 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:24.280954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3469-5abd-473f-bbea-3ea02b3aaac0 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.281248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3469-5abd-473f-bbea-3ea02b3aaac0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.281530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d3469-5abd-473f-bbea-3ea02b3aaac0 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.283069 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 384/772] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:24.288723 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.289016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.289293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.308372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:24.309612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:24.380440 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 389/773] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:24 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:24.405787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3469-5abd-473f-bbea-3ea02b3aaac0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:24.490043 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:24.506865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d3469-5abd-473f-bbea-3ea02b3aaac0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:24.542432 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:24.543157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.543440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.543714 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.544340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:24.545696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:24.554563 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:24.555817 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:24.557146 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 385/774] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:24.562257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:24.628769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:24.666937 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b59255-aafc-4294-9e99-f29d08d45437 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:24.700689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:24.701312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.701590 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.701860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.702565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:24.702866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:24.704227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:24.708947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 390/775] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:24.715501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:24.814024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb8d-99c9-47d2-a246-cfd88bcdd48b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:24.846903 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:24.847517 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.847798 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.848072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.848744 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:24.849049 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:24.850441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:24.855659 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 386/776] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:24.861515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:24.960576 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b1070-b828-4897-8e0f-1b1355242855 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:24.986725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:24.994693 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:24.996004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:24.996287 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:24.996648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:24.997403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] RBAC: Adding query filter params (interface=public, service_id=4c20dcf0247a48f191557ea74b564a61, region_id=RegionOne) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:24.997712 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:24.999103 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edf1dd-e4fc-4aa6-bb18-63890bae9ab9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:25.004065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 391/777] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:03:24 2022] GET /identity/v3/endpoints?service_id=4c20dcf0247a48f191557ea74b564a61&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:25.009599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:25.024688 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:25.107253 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52453-da57-4fc3-afe9-7ada5bb49d51 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:25.139607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6842a6b-8fe1-49c4-ae7c-b5b5536fc587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:25.140219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842a6b-8fe1-49c4-ae7c-b5b5536fc587 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:25.140509 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842a6b-8fe1-49c4-ae7c-b5b5536fc587 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:25.140786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842a6b-8fe1-49c4-ae7c-b5b5536fc587 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:25.141428 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6842a6b-8fe1-49c4-ae7c-b5b5536fc587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:25.142826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6842a6b-8fe1-49c4-ae7c-b5b5536fc587 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:25.148546 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 387/778] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:03:25 2022] GET /identity/v3/services => generated 1498 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:26.457938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08aefa-ee8c-447e-aab0-b6d169c966c1 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:26.458528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08aefa-ee8c-447e-aab0-b6d169c966c1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:26.458528 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08aefa-ee8c-447e-aab0-b6d169c966c1 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:26.459865 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 392/779] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:26.465853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85422f4-6e37-4070-a683-65f432075164 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:26.466268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85422f4-6e37-4070-a683-65f432075164 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:26.466434 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85422f4-6e37-4070-a683-65f432075164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:26.484369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c85422f4-6e37-4070-a683-65f432075164 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:26.485553 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c85422f4-6e37-4070-a683-65f432075164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:26.549974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 388/780] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:26.573988 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08aefa-ee8c-447e-aab0-b6d169c966c1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:26.675173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08aefa-ee8c-447e-aab0-b6d169c966c1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:26.708451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:26.709016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:26.709296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:26.709571 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:26.710197 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:26.711578 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:26.721018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:26.721979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:26.722871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 393/781] 10.222.0.48 () {56 vars in 1132 bytes} [Mon Jul 25 23:03:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:26.728235 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85422f4-6e37-4070-a683-65f432075164 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:26.736359 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:26.828921 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85422f4-6e37-4070-a683-65f432075164 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:26.861859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:26.862504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:26.862784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:26.863056 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:26.863730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:26.864032 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:26.865399 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:26.870037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 389/782] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 23:03:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:26.876419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:26.930665 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:26.975408 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce4dc-4fb1-4a6b-ab56-db5a06e28406 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:27.008732 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:27.009347 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.009626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.009904 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.010620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:27.011519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:27.013159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853af7f-08c4-4de3-9b64-c1f5bf29a369 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:27.017897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 394/783] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 23:03:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:27.023570 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:27.091976 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:27.123114 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901424e-5c96-4290-8b3f-6d40dbe3b06c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:27.156605 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a686378-36b4-4de7-9426-e089abe1eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:27.157214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686378-36b4-4de7-9426-e089abe1eb86 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.157491 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686378-36b4-4de7-9426-e089abe1eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.157763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686378-36b4-4de7-9426-e089abe1eb86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.158490 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a686378-36b4-4de7-9426-e089abe1eb86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:27.159840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a686378-36b4-4de7-9426-e089abe1eb86 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:27.242194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 390/784] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:27.409138 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5dcf4-a7a5-4d78-8933-13a45522a37f None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.409497 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5dcf4-a7a5-4d78-8933-13a45522a37f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.409704 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5dcf4-a7a5-4d78-8933-13a45522a37f None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.411075 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 395/785] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:27.416379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.416667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.416940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.436112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:27.437352 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:27.509813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 391/786] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:27 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:27.534250 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5dcf4-a7a5-4d78-8933-13a45522a37f None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:27.639307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5dcf4-a7a5-4d78-8933-13a45522a37f None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:27.655985 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:27.673095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:27.673740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.674022 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.674323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.674959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:27.676310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:27.685725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:27.686956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:03:27.688080 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:27.690453 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 396/787] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:27.692799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:27.744691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:27.791886 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd650e6b-f577-4118-9a9a-bfaea38c4c12 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:27.826001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:27.826657 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.826944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.827217 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.827898 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:27.828201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:27.829554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:27.834523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 392/788] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:27.839970 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:27.939897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b609-b972-461b-bbbd-dab559816d15 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:27.973305 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:27.973921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:27.974198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:27.974498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:27.975175 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:27.975475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:27.976829 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6246d-0ec9-41ac-a576-0f13c0821735 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:27.982679 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 397/789] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 23:03:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:27.988273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:28.086470 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea33c6-7e0a-4d16-a5ff-fcfcc2ac6fc7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:28.102405 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:28.119858 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab9bf-9b7d-4aae-b931-9d538469687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:28.120989 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab9bf-9b7d-4aae-b931-9d538469687e None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:28.121269 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab9bf-9b7d-4aae-b931-9d538469687e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:28.121542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab9bf-9b7d-4aae-b931-9d538469687e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:28.122249 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab9bf-9b7d-4aae-b931-9d538469687e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:28.123625 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab9bf-9b7d-4aae-b931-9d538469687e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:28.269428 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 393/790] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:03:29.494725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad832-146c-4448-919e-982d0aa7dc67 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.495535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad832-146c-4448-919e-982d0aa7dc67 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.495535 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad832-146c-4448-919e-982d0aa7dc67 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.496807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 398/791] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:29.502195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.505554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.505554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.521384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:29.522596 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:29.600864 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 394/792] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:29.624116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad832-146c-4448-919e-982d0aa7dc67 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:29.677250 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:29.730585 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad832-146c-4448-919e-982d0aa7dc67 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:29.764176 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:29.764747 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.765031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.765309 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.765933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:29.767331 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:29.775941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:29.777233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:29.778086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 399/793] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:29.783493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:29.877342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:29.880795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca4c3-fd29-47e7-b478-d66f143ca362 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:29.914436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:29.915054 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:29.915337 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:29.915615 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:29.916295 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:29.916601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:29.917997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61f17-b2fc-41e1-9104-53c9e36d1392 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:29.922566 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 395/794] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:29.928245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.029904 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f355314-35e0-41a7-b194-7c2f6195bd95 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.040032 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:30.063870 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.064490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.064774 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.065050 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.065728 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] RBAC: Adding query filter params (type=compute) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:30.066032 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.067438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc420d-9a87-45c0-8ddc-d6da5788146a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.072113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 400/795] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:30.519128 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246b26-fcfb-4ba5-ba27-a281fe2f273b None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.519680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246b26-fcfb-4ba5-ba27-a281fe2f273b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.519680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246b26-fcfb-4ba5-ba27-a281fe2f273b None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.521019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 396/796] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:30.526917 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.527654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.527654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.546201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:30.547420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:30.617636 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 401/797] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:30 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:30.641724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246b26-fcfb-4ba5-ba27-a281fe2f273b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.742360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246b26-fcfb-4ba5-ba27-a281fe2f273b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.774808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.775355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.775634 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:30.775905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:30.777357 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:30.778792 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:30.781360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING keystone.server.flask.common [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 23:03:30.841055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.sql.core [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 23:03:30.841055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 23:03:30.841055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [parameters: {'id': '27ac6edd06984f5580992dfcdbf476a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 23:03:30.841055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87489) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27ac6edd06984f5580992dfcdbf476a9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27ac6edd06984f5580992dfcdbf476a9. Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:03:30.857705 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result.read() Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 23:03:30.859064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application yield resource Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise self.value Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application session.commit() Jul 25 23:03:30.860552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.session.flush() Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application compat.raise_( Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 23:03:30.861663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 23:03:30.862826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result.read() Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:03:30.864012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [parameters: {'id': '27ac6edd06984f5580992dfcdbf476a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:30.865139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:30.866201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27ac6edd06984f5580992dfcdbf476a9. Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:30.867542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 397/798] 10.222.0.48 () {60 vars in 1140 bytes} [Mon Jul 25 23:03:30 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:30.868414 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:30.965133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea768c23-ff82-47de-b267-d2e81aa7a692 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:30.967451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:30.998074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:30.999002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:30.999433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.000004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.006772 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:31.008167 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-f8eb6613-953c-435d-99a8-17f8c5ad31dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:03:31.020285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:31.021401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:31.022649 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 402/799] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:31.028860 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:31.049316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:31.131364 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56843f1-0c20-4fe8-b9dc-52f332244e86 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:31.171418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:31.172037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:31.172317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:31.172590 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:31.173310 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:31.173613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:31.175274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245f13-c824-4ca5-b152-e2cc9c929353 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:31.195660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 398/800] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:32.336718 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348d56-7df6-40e0-894f-f28c86393b16 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:32.337293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348d56-7df6-40e0-894f-f28c86393b16 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:32.337293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348d56-7df6-40e0-894f-f28c86393b16 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:32.338638 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 403/801] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:32.344655 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348243-a19f-447c-b6cc-f8e30895173b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:32.345064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348243-a19f-447c-b6cc-f8e30895173b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:32.345215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348243-a19f-447c-b6cc-f8e30895173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:32.364188 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-0e348243-a19f-447c-b6cc-f8e30895173b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:32.365764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-0e348243-a19f-447c-b6cc-f8e30895173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:32.435821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 399/802] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:32.459454 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348d56-7df6-40e0-894f-f28c86393b16 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:32.558063 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348d56-7df6-40e0-894f-f28c86393b16 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:32.593857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc38460-ba88-42fb-bcda-19b7f6fc7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:32.594512 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc38460-ba88-42fb-bcda-19b7f6fc7af0 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:32.594794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc38460-ba88-42fb-bcda-19b7f6fc7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:32.595065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc38460-ba88-42fb-bcda-19b7f6fc7af0 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:32.595758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc38460-ba88-42fb-bcda-19b7f6fc7af0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:32.597115 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc38460-ba88-42fb-bcda-19b7f6fc7af0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:32.682327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 404/803] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:03:32 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:33.530058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5ade-ac80-4a4a-807f-e24047d00043 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:33.530633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5ade-ac80-4a4a-807f-e24047d00043 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:33.530633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5ade-ac80-4a4a-807f-e24047d00043 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:33.531963 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 400/804] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:33.537215 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:33.537661 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:33.537755 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:33.556779 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:33.558030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:33.577513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:33.644738 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 405/805] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:33 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:33.674835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f5ade-ac80-4a4a-807f-e24047d00043 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:33.690421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:33.794781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f5ade-ac80-4a4a-807f-e24047d00043 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:33.833998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:33.834668 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:33.834946 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:33.835221 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:33.835930 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:33.837408 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:33.887134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.sql.core [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 23:03:33.887134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 23:03:33.887134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [parameters: {'user_id': 'de1146ea8bf7420ca14a04072dd44534', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 23:03:33.887134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87489) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result.read() Jul 25 23:03:33.893724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:03:33.894738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application yield resource Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise self.value Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application session.commit() Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 23:03:33.895687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.session.flush() Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application compat.raise_( Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 23:03:33.896583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:03:33.897471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application result.read() Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:03:33.898349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [parameters: {'user_id': 'de1146ea8bf7420ca14a04072dd44534', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:33.899178 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 23:03:33.899974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:33.900901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 401/806] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 23:03:33 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:33.902337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:33.998660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff1d1-0497-41f6-b249-26f735261a59 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:34.032947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:34.033579 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:34.033859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:34.034135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:34.041098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:34.042908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-6bff0ed6-6b2a-4e21-8b32-26d2e9ad1338 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:03:34.054563 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:34.055511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:34.056461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 406/807] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:03:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:34.061795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:34.131688 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:34.163031 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25b3a8-57fa-4f33-97fd-475bc445f3ca None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:34.199501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:34.200126 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:34.200444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:34.200670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:34.201427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:34.201752 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:34.203416 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eab9a-d06a-4612-8bdb-f94bcd46c2f8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:34.242788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 402/808] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 23:03:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:34.945829 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6bba-19d0-4323-83c1-e92b08b45310 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:34.946363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6bba-19d0-4323-83c1-e92b08b45310 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:34.946481 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6bba-19d0-4323-83c1-e92b08b45310 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:34.947933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 407/809] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:34.953806 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:34.954231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:34.954390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:34.972710 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:34.974222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:35.040828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 403/810] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:34 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:35.065422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a6bba-19d0-4323-83c1-e92b08b45310 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:35.078856 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:35.168500 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a6bba-19d0-4323-83c1-e92b08b45310 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:35.201329 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:35.201897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:35.202177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:35.202476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] PATH_INFO: `/v3/services/compute` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:35.203097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:35.204451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:35.212967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:35.214137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:03:35.215233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:35.220246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:35.277955 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:35.318415 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff67ce6-41d7-460a-96df-b9917d583860 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:35.351700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:35.352309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:35.352593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:35.352871 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:35.353554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:35.353861 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:35.355391 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:35.360125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 404/812] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:35.365735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:35.439412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:35.464145 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e439f-34ad-49b0-91c5-3e020fc993df None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:35.497212 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:35.497815 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:35.498097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:35.498399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:35.499067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:35.499372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:35.500721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:35.505375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 409/813] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:35.511801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:35.609320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c8d25-d6c1-4d08-ac8d-310e8f4946c1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:35.630968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:35.642671 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:35.643287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:35.643565 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:35.643836 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:35.644579 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] RBAC: Adding query filter params (interface=public, service_id=ea9924a1b9264c1da9fa38030aa3cfdc, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:35.644886 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:35.646235 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d2342-8c86-4770-9634-51d86685241d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:35.651970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 405/814] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:03:35 2022] GET /identity/v3/endpoints?service_id=ea9924a1b9264c1da9fa38030aa3cfdc&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:35.657611 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:35.755401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739529-5a98-4b88-805e-2b5e6888e708 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:35.788295 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f2d5-4825-4f48-bb29-5961b79fde13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:35.788900 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f2d5-4825-4f48-bb29-5961b79fde13 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:35.789182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f2d5-4825-4f48-bb29-5961b79fde13 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:35.789461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f2d5-4825-4f48-bb29-5961b79fde13 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:35.790107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f2d5-4825-4f48-bb29-5961b79fde13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:35.791494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f2d5-4825-4f48-bb29-5961b79fde13 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:35.798079 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 410/815] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:03:35 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:03:38.046192 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59ed0-e7ff-4bf2-9c00-fddb89b8b8e6 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:38.046795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59ed0-e7ff-4bf2-9c00-fddb89b8b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:38.046795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59ed0-e7ff-4bf2-9c00-fddb89b8b8e6 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:38.048108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 406/816] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:03:38.053362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:38.053734 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:38.053912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:38.060468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:38.072276 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:03:38.073757 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:03:38.139553 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 411/817] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:03:38 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:03:38.163173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59ed0-e7ff-4bf2-9c00-fddb89b8b8e6 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:38.265804 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59ed0-e7ff-4bf2-9c00-fddb89b8b8e6 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:38.300716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:38.301263 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:38.301543 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:38.301818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:38.302472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:38.303909 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:03:38.313334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:03:38.314316 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:03:38.315208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 407/818] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:03:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:03:38.320951 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:38.421247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe34a95-6246-4237-a9cc-590b7719e128 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:38.452587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:38.457403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:38.458020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:38.458305 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:38.458586 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:38.459261 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:38.459559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:38.460916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:38.465842 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 412/819] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:38.471743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:38.522129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:38.572630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7807-6341-4253-9e88-f240f1901ff0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:38.606775 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:38.607388 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:38.607666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:38.607939 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:38.608610 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] RBAC: Adding query filter params (type=compute) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:03:38.608911 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:38.610266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d27a9-f1b7-47e2-ad7c-2dd17c93d56b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:38.615184 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 408/820] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 23:03:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:03:38.621801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:38.720996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0a34-f854-48f6-81c2-df5943614c9a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:38.754717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afa48d-0c4e-486f-aec7-e4c1e4a9a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:38.755323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa48d-0c4e-486f-aec7-e4c1e4a9a302 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:38.755605 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa48d-0c4e-486f-aec7-e4c1e4a9a302 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:38.755903 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa48d-0c4e-486f-aec7-e4c1e4a9a302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:38.756632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afa48d-0c4e-486f-aec7-e4c1e4a9a302 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:38.758015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afa48d-0c4e-486f-aec7-e4c1e4a9a302 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:38.839501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 413/821] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:03:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:03:48.612639 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=43 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.834520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:59.270834 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f7e89-a34a-4061-8ca5-f2448f926a84 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:59.271421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f7e89-a34a-4061-8ca5-f2448f926a84 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:59.271421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f7e89-a34a-4061-8ca5-f2448f926a84 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:59.272729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 409/822] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:59.278143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:59.278572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:59.278719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:59.297577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:59.299544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:59.373580 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 414/823] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:04:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:04:59.399262 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f7e89-a34a-4061-8ca5-f2448f926a84 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:59.499849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f7e89-a34a-4061-8ca5-f2448f926a84 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:59.533895 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:59.534488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:59.534763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:59.535029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:59.545030 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:59.546481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:04:59.560293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:04:59.561433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:04:59.562758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:04:59.562758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:04:59.562758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:04:59.562758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:04:59.562758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 410/824] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:04:59.568299 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:59.667270 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2826d6-fcab-46e8-8169-0d8525ff3b03 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:59.694015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:59.702521 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:59.703146 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:59.703432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:59.703710 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:59.705320 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:04:59.705619 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:59.707009 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7158-a5c3-43fe-baac-e6a46e405532 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:59.717891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 415/825] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:04:59.723788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:59.777176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:59.823313 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43167fd4-a1c8-4173-9eb1-aa09ceb7f322 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:59.855183 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c845821-fe8b-48c9-bd8e-09e580b95fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:59.855799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845821-fe8b-48c9-bd8e-09e580b95fc9 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:59.856081 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845821-fe8b-48c9-bd8e-09e580b95fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:59.856355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845821-fe8b-48c9-bd8e-09e580b95fc9 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:59.857028 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c845821-fe8b-48c9-bd8e-09e580b95fc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:59.858479 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c845821-fe8b-48c9-bd8e-09e580b95fc9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:00.089165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 411/826] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 23:04:59 2022] POST /identity/v3/users => generated 251 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:02.370203 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591be47-e48d-4f42-ae93-3ed5994b4a89 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:02.370805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591be47-e48d-4f42-ae93-3ed5994b4a89 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:02.370805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591be47-e48d-4f42-ae93-3ed5994b4a89 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:02.372137 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 416/827] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:02.377672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:02.381033 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:02.381033 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:02.396242 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:02.397543 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:02.464506 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 412/828] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:02.490387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591be47-e48d-4f42-ae93-3ed5994b4a89 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:02.594227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591be47-e48d-4f42-ae93-3ed5994b4a89 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:02.629163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:02.629730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:02.630012 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:02.630301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:02.640606 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:05:02.645634 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:02.657296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:02.659456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 417/829] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:05:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:02.660423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:02.693681 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:02.751743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852572-e776-4136-876c-bbf0c5969104 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:02.786902 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:02.787514 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:02.787859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:02.788131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:02.788835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:02.789136 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:02.790580 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:02.798477 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 413/830] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:05:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:02.804498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:02.851456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:02.905677 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c93c5-b57c-4b98-9022-2b7a6bef74d4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:02.939037 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:02.940337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:02.941116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:02.941116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:02.952291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:02.953729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:02.968120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:02.969160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:02.970099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:02.970099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:02.970099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:02.970099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:02.970099 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 418/831] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:02.975662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.073142 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:03.076042 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e58e-35ce-428c-9a61-fa71bc8c8a5d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:03.109432 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:03.110093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.110394 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.110669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.111921 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:03.112770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:03.114127 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.125497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 414/832] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:03.131630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.227448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:03.231318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309e4df-33c6-4b27-bb52-ddd298286690 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:03.265163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:03.265163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.265163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.265163 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.273506 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:03.275028 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:05:03.286861 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:03.290807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:03.291992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 419/833] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:03.294037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.392472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b6e42-4d7e-4192-8d85-c17d85126607 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:03.426685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:03.427539 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.427539 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.427804 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.428579 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:03.428880 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:03.430309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.446664 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 415/834] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 23:05:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:03.452667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.552636 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628d1f8-0d04-4f61-bda2-3ebe03cc449a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:03.585722 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:03.586362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.586645 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.586918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.614906 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:03.654236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:03.655714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.751442 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 420/835] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:05:03 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:05:03.757328 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.776504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:03.857134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44886d08-7a8e-405e-8cb3-f06d6e1a3f5f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:03.889640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:03.890268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:03.890581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:03.890848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:03.901400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:03.908194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:03.916878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:03.917942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:03.919094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:03.919094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:03.919094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:03.919094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:03.919094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 416/836] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:03.924006 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:03.981584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:04.022998 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecab7-7fea-48ae-a1b6-1b54d31db3fd None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.056136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.056756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.057036 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.057311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.057995 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:04.058322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.059754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.072183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 421/837] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:04.078529 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.146519 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:04.175983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df386257-5d00-4171-b2bb-4d55dc1130b0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.208362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.208989 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.209266 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.209535 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.215896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.217326 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:05:04.229207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:04.237691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:04.238840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 417/838] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:04.239476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.337470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b4d64-6603-4bce-acad-e68ce16cce8e None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.354158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:04.371062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.371676 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.371956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.372227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.373020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:04.373391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.374862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d856e-15b5-4330-b0f0-49fd8001e90e None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.387070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 422/839] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:04.393802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:04.496881 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b67a9-f742-4e1d-93b6-f74aac25fa4a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:04.524634 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:04.530482 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:04.531092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:04.531368 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:04.531639 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:04.532410 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=1fad215896be49bca76dd44ccb1bdb58) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:04.532708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:04.535025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed456b-92e9-4359-86a5-288a2bb47735 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:04.540321 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 418/840] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:05:04 2022] GET /identity/v3/role_assignments?user.id=1fad215896be49bca76dd44ccb1bdb58&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:06.775311 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f135e1-b3b9-4300-a3f7-2c86cf9462db None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:06.776400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f135e1-b3b9-4300-a3f7-2c86cf9462db None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:06.776400 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f135e1-b3b9-4300-a3f7-2c86cf9462db None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:06.777892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 423/841] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:06.783052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:06.783680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:06.783680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:06.801998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:06.803246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:06.870273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 419/842] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:06.894718 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f135e1-b3b9-4300-a3f7-2c86cf9462db None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:06.999468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f135e1-b3b9-4300-a3f7-2c86cf9462db None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.034724 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.035428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.035710 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.036005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.045971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:05:07.051262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:07.052357 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:07.053363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 424/843] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:07.058554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.156005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080e0e-a7ca-45bd-a10b-64eaae33d523 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.179420 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:07.190508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.191159 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.191432 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.191703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.192404 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:07.192703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.194048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.201607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 420/844] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:07.207756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.246635 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:07.305173 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfb735-4afb-4769-88fd-0aa7ff71df40 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.338858 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.339494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.339774 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.340044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.350155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.351621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:07.366461 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:07.367791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:07.368706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:07.368706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:07.368706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:07.368706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:07.368706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 425/845] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:07.373633 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.475408 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d654f-7c32-45b3-9fe4-39dca08edf64 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.510012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.510648 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.510941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.511220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.511929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:07.512216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.513578 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.525740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 421/846] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:07.531939 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.625480 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:07.635657 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e909-0a4c-4168-9de7-2442a25cbbd3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.668642 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.669277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.669620 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.669903 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.677128 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.678624 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:05:07.690098 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:07.691376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:07.692589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 426/847] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:07.697270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.745446 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:07.797464 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168d21c-0c18-4603-8bbb-073922dc5e2e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.830992 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.831597 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.831878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.832152 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:07.832932 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:07.833236 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:07.834729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:07.852434 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 422/848] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 23:05:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:07.858575 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:07.959065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54207c7-5bc4-47ee-9e77-2acbb0000a85 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:07.993209 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:07.993846 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:07.994121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:07.994462 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:08.006976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:08.006976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:08.020482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:08.021514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:08.022689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:08.022689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:08.022689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:08.022689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:08.022689 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 427/849] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:08.027979 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:08.128732 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7218eb-059e-4b04-8325-d6cd53f8ba7a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:08.131048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:08.163293 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:08.163936 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:08.164217 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:08.164492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:08.165176 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:08.165480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:08.166873 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:08.177920 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 423/850] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:08.183739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:08.186608 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:08.280631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506039-73c7-4179-ba93-0ad888567904 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:08.313750 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:08.314918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:08.315198 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:08.315472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:08.322066 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:08.323547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:05:08.335323 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:08.338984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:08.340121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 428/851] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:08.342673 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:08.442160 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20c02a-5b34-4cb8-af07-9a92b0166cbd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:08.475490 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:08.476108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:08.476389 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:08.476667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:08.477415 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:08.477725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:08.479191 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1f3ff-fcfe-40be-b4d2-26d61283185c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:08.491086 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 424/852] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:08.497314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:08.560457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:08.600183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2d211-d7e7-4a0a-97d2-96083e08af67 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:08.633152 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6626bd-3be6-4a33-8703-9338a92ec7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:08.633814 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6626bd-3be6-4a33-8703-9338a92ec7f0 None admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:08.634097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6626bd-3be6-4a33-8703-9338a92ec7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:08.634399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6626bd-3be6-4a33-8703-9338a92ec7f0 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/1fad215896be49bca76dd44ccb1bdb58/roles/a3ed697fe45143698b5b7d9c06ff2396` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:08.649118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6626bd-3be6-4a33-8703-9338a92ec7f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=1fad215896be49bca76dd44ccb1bdb58, role_id=a3ed697fe45143698b5b7d9c06ff2396)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:08.650577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6626bd-3be6-4a33-8703-9338a92ec7f0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:08.803540 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 429/853] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:05:08 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/1fad215896be49bca76dd44ccb1bdb58/roles/a3ed697fe45143698b5b7d9c06ff2396 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:11.022093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7023bc-10e6-496e-9585-4b11685f3380 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.022662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7023bc-10e6-496e-9585-4b11685f3380 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.022752 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7023bc-10e6-496e-9585-4b11685f3380 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.024064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 425/854] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:11.029457 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.029849 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.030044 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.048110 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:11.049436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:11.113536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 430/855] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:11.137842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7023bc-10e6-496e-9585-4b11685f3380 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.164519 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.240290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7023bc-10e6-496e-9585-4b11685f3380 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.273131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.273698 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.273977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.274245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.285400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:05:11.290559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:11.291628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:11.292677 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 426/856] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:11.297937 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.340891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.395962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98170c-95f9-469b-bdcd-29dc147ee4d6 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.428949 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.429559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.429836 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.430111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.430852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] RBAC: Adding query filter params (name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:11.431153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.432516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.442083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 431/857] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:11.448116 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.534233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.549865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973718fa-35a5-462a-a663-8fdeb266fbca None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.586005 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.586679 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.586972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.587251 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.598542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.602536 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:11.613845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:11.614960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:11.616181 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:11.616181 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:11.616181 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:11.616181 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:11.616181 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 427/858] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:11.620742 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.722049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663caf3-581a-48c4-a59c-f96c33cf832a None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.724438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.755911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.756516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.756793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.757062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.757747 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:11.758045 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.759429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.771084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 432/859] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:11.776980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:11.879407 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e55538-c470-4569-af4e-949602b3f055 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:11.913993 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:11.914664 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:11.914945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:11.915219 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:11.917827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:11.922760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:11.924754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:05:11.935712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:11.940994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:11.942158 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 428/860] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:11.943760 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.044286 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39046b52-5022-42b4-b450-adc7d1f66cf9 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.078579 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.079193 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.079472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.079746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.080532 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:12.080982 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.082427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.099515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 433/861] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 23:05:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:12.105434 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.209600 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f9b8e-1c68-4a98-9225-e5103b1e849c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.245972 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.246644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.246897 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.247179 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.306375 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:12.312703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.314143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.409736 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 429/862] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:05:12 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:05:12.415823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.440713 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:12.513848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeef944-219b-4b1f-97f1-452cbd72fbe0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.557709 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.558377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.558658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.558932 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.568833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.570268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:12.585196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:12.586378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:12.587326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:12.587326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:12.587326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:12.587326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:12.587326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 434/863] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:12.592583 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.685102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:12.690921 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d149-b918-4c18-879d-137bec91e4d6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.724782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.725402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.725684 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.725959 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.726674 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:12.726981 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.728372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.739260 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 430/864] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:12.763261 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:12.822396 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:12.849033 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e202fbd-7ec8-45ca-8f2a-08128e57fe7b None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:12.881603 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:12.882239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:12.882585 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:12.882854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:12.889614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:12.891154 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:05:12.902799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:12.903871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:12.905229 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 435/865] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:05:12.910781 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:13.010716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7281184-9045-4f97-a67f-d5dafa86c33d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:13.043771 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:13.044384 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:13.044667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:13.044944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:13.045695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:13.046045 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:13.047527 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a515e3-d33c-4d92-9ecc-848419202e42 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:13.059872 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 431/866] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:13.066118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:13.166239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d1bbe-ed6e-411e-8843-cb658ab18dd8 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:13.199431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:13.210438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:13.210438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:13.210438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:13.210438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] RBAC: Adding query filter params (role.id=a3ed697fe45143698b5b7d9c06ff2396, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=1fad215896be49bca76dd44ccb1bdb58) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:13.210438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:13.210438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07da07-524a-439c-a6be-223d2805ab90 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:13.210920 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:13.211777 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 436/867] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:05:13 2022] GET /identity/v3/role_assignments?user.id=1fad215896be49bca76dd44ccb1bdb58&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=a3ed697fe45143698b5b7d9c06ff2396 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:15.572432 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3317-a8d7-480a-bb14-b18245a11510 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.572964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3317-a8d7-480a-bb14-b18245a11510 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.572964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b3317-a8d7-480a-bb14-b18245a11510 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.574369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 432/868] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:15.579684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.580145 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.580775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.599702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:15.600883 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:15.668483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 437/869] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:15.693628 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3317-a8d7-480a-bb14-b18245a11510 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.712467 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:15.796087 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b3317-a8d7-480a-bb14-b18245a11510 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.829486 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.830058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.830369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.830659 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.840708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:05:15.845513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:15.847282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:15.848348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 433/870] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:15.853607 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:15.952519 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5460-1009-40e2-9336-52a339404e04 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:15.978567 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:15.987209 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:15.987926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:15.988214 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:15.988492 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:15.989211 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:15.989542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:15.990913 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:15.999165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 438/871] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:16.004848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:16.082954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:16.105627 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada0372-077c-4c4d-9c2e-617d5d64e103 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:16.138127 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:16.138820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:16.139103 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:16.139379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:16.149607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:16.151335 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:16.165923 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:16.166912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:16.167852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:16.167852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:16.167852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:16.167852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:16.167852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 434/872] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:16.172967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:16.271891 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b68873-1170-43f9-bfb6-cf390691eee5 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:16.305091 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:16.305702 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:16.305984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:16.306262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:16.306974 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:16.307278 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:16.308629 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:16.319992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 439/873] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:16.325680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:16.427750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff1455-96fd-4b1a-9b95-36f1c1e0c0e9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:16.452431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:16.460942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:16.461577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:16.461856 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:16.462129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:16.469497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:16.471848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:05:16.482929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:16.484061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:16.485503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 435/874] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:16.491779 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:16.543317 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:16.596666 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29074a1-7ef1-4a33-8856-0e8c14d861b4 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:16.630572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:16.631183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:16.631459 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:16.631732 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:16.632516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:16.632817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:16.634223 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:16.651644 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 440/875] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 23:05:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:16.657518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:16.757115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbd3a-1b5a-4f42-b876-026de2cf72f3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:16.790666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:16.791276 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:16.791556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:16.791829 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:16.846527 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:16.858412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:16.859897 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:16.959857 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 436/876] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:05:16 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:05:16.965778 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.070352 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d1940-bf22-4f4a-b49a-0d970b1dccd7 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.079536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:17.103181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.103818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.104097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.104370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.114490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.115949 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:17.130915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:17.131986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:17.132948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:17.132948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:17.132948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:17.132948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:17.132948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 441/877] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:17.138061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.223472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:17.234940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572e5f9-f799-4100-b32c-f975c1c93792 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.268680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.269348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.269828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.270353 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.271418 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:17.271728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.273093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.284992 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 437/878] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:17.291262 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.391892 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357cffb-ae7d-4cc7-9342-276b72e2de92 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.426134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.426804 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.427089 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.427366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.434014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.435562 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:05:17.446843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:17.447916 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:17.453838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 442/879] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:17.454472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.557942 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd29c5-7738-4798-b42c-ffa2f827e32b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.596444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.597071 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.597422 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.597723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.598513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:17.598819 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.600232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf822-1fb5-443e-b9bd-8c3f504e2ab0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.618398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 438/880] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:17.622719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:17.653233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:17.731806 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6e53-aca9-42da-83dd-2308508756f5 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:17.765109 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:17.765720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:17.765997 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:17.766304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:17.767107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=1fad215896be49bca76dd44ccb1bdb58) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:17.767946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:17.769809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab614e4-d39d-4d62-820f-a878eb3818d3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:17.775153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 443/881] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:05:17 2022] GET /identity/v3/role_assignments?user.id=1fad215896be49bca76dd44ccb1bdb58&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=b808049b0af24ba79f7b5a53a732242d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:20.035701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9e33-c149-496b-8a68-eb47c9b50598 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.036250 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9e33-c149-496b-8a68-eb47c9b50598 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.036343 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9e33-c149-496b-8a68-eb47c9b50598 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.037613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 439/882] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:20.042855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.043237 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.043414 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.061996 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:20.063233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:20.129382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 444/883] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:20.153009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9e33-c149-496b-8a68-eb47c9b50598 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.164065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:20.254246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9e33-c149-496b-8a68-eb47c9b50598 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.291215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.291782 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.292064 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.292338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.302685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:05:20.307700 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:20.308787 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:20.309821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 440/884] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:20.315947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.331494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:20.412890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723bb4-52da-4760-959d-e0faeb77c7af None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.446696 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.447313 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.447591 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.447862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.448568 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:20.448869 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.450216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.459035 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 445/885] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:20.464839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.534652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:20.567814 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fbb1d-581e-4632-a95f-ee667879e839 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.603337 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.603978 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.604261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.604542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.615246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.616723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:20.631373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:20.632471 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:20.633426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:20.633426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:20.633426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:20.633426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:20.633426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 441/886] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:20.638362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.717165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:20.740041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524f857-d103-478e-96c8-4eed9d5eb8c9 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.772894 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.773509 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.773796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.774067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.774791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:20.775097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.776721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.788200 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 446/887] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:20.793938 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:20.895104 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366d98b-5196-4b34-84cd-0d5e489e11bf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:20.914151 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:20.928850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:20.929645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:20.929952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:20.930227 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:20.937687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:20.939331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:05:20.951397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:20.952507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:20.953507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 442/888] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:20.958630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.059833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169783a-76f7-41a1-a79f-964020425a01 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.093216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.093884 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.094162 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.094470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.095326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:21.095622 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.097725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.100348 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:21.115074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 447/889] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 23:05:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:21.120776 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.219093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91536000-0c9d-4d4d-b7ec-c8750436a94c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.253214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.253845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.254122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.254424 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.264543 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.265961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:21.279854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:21.280975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:21.281876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:21.281876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:21.281876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:21.281876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:21.281876 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 443/890] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:21.287538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.386587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793e92-4f5c-463e-ae40-6cf1f4ccd895 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.420971 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.421592 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.421876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.422151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.422875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:21.423180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.424639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.435848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 448/891] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:21.441713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.475484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:21.543353 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942771e7-aec0-4c47-baa7-3074fcd2dabf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.577155 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.577796 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.578077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.578387 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.585654 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.587149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:05:21.599984 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:21.601140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:21.602078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 444/892] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:21.607091 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.662108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:21.704030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b01469-d4da-4e92-8cb4-913991022ea3 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.737567 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.738170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.738557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.738833 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.739572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:21.739875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.741284 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777f01-3ce5-4182-a950-73c6391028ad None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:21.754181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 449/893] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:21.760250 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:21.851204 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:21.859765 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609132-9591-4a95-89b5-ad3673b1f72e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:21.892809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9f5f-e798-42db-8eaa-90f89e040b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:21.896682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9f5f-e798-42db-8eaa-90f89e040b69 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:21.896682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9f5f-e798-42db-8eaa-90f89e040b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:21.896682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9f5f-e798-42db-8eaa-90f89e040b69 None admin] PATH_INFO: `/v3/projects/7748d2920dac498f818e384b384de2b1/users/1fad215896be49bca76dd44ccb1bdb58/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:21.897098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9f5f-e798-42db-8eaa-90f89e040b69 None admin] RBAC: Authorizing `identity:create_grant(project_id=7748d2920dac498f818e384b384de2b1, user_id=1fad215896be49bca76dd44ccb1bdb58, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:21.898689 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9f5f-e798-42db-8eaa-90f89e040b69 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:22.048593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 445/894] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 23:05:21 2022] PUT /identity/v3/projects/7748d2920dac498f818e384b384de2b1/users/1fad215896be49bca76dd44ccb1bdb58/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:05:24.298602 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6856d-a2d8-4c48-a2fc-814b4f5d4c5a None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.300182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6856d-a2d8-4c48-a2fc-814b4f5d4c5a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.300182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6856d-a2d8-4c48-a2fc-814b4f5d4c5a None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.301085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 450/895] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:24.306407 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.306786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.306979 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.325713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:24.327008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:24.394307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 446/896] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:24 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:24.420587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6856d-a2d8-4c48-a2fc-814b4f5d4c5a None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:24.522650 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6856d-a2d8-4c48-a2fc-814b4f5d4c5a None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:24.538067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:24.557666 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:24.558231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.558541 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.558813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.568550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:05:24.573303 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:24.574444 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:24.575729 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 451/897] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 23:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:24.581480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:24.663143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:24.680670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f94c-33ae-4012-82ad-d5cfb5ce70b4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:24.714540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:24.715317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.715608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.715887 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.716599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:24.716906 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:24.718269 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:24.727175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 447/898] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 23:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:24.732897 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:24.842494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655ea2-a138-49b3-ac5b-c705f30e5c1d None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:24.880281 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:24.880955 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:24.881234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:24.881502 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:24.891807 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:24.893876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:24.907821 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:24.909292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:24.910513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:24.910513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:24.910513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:24.910513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:24.910513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 452/899] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:24.915989 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.018554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7eaef-36b6-42be-94a4-70e2f2935353 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.053037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.053678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.053959 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.054234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.054979 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:25.055257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.056627 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.068524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 448/900] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:25.074170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.102573 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.174742 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9a83-6d68-45d1-a510-a78a01bb4e02 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.207120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.207741 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.208021 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.208292 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.215486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.220201 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:05:25.228321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:25.229381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:25.230895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 453/901] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:25.235454 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.242559 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.338895 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff855-8eb1-4665-9627-51e5877e8d6d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.371941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.372495 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.372774 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.373046 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.373822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:25.374127 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.375560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.393152 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 449/902] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 23:05:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:05:25.398972 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.483005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.497936 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8754d-2800-42d6-8ca3-9e84acdcbf00 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.533027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.534655 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.534655 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.534902 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.607372 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.608819 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.691799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.706888 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 454/903] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 23:05:25 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:05:25.712640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.774274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:25.812077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d83c-8c29-4752-baf8-73d794b2fda8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:25.847640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:25.848314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:25.848610 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:25.848888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:25.859508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:25.860966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:05:25.876052 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:25.877248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:25.879621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:05:25.879621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:05:25.879621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:05:25.879621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:25.879621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 450/904] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:25.883571 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:25.985728 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd113-e26d-4f98-a4e4-85a72e0c03f0 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.019331 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.019946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.020230 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.020505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.021193 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:26.021500 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.022972 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.035145 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 455/905] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 23:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:26.041008 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.141519 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd250a1-0ff6-41ae-a34d-381b0c45a34a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.156265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:26.175922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.176554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.176849 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.177121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.183566 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.185010 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:05:26.195889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:26.196970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 25 23:05:26.198268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 451/906] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 23:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:26.203186 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.250443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:26.307834 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035ae6a-bb59-446f-a5a1-f298ac5fbb60 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.342304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.342929 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.343207 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.343525 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.344264 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:26.344564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.346521 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d40ee-16d0-432a-aedc-59995c3e405f None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.358140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 456/907] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 23:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:26.364329 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:26.465825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406555b-97d2-4d13-90de-0e5035793954 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:26.500385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:26.508220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:26.508220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:26.508220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:26.508220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] RBAC: Adding query filter params (role.id=b808049b0af24ba79f7b5a53a732242d, scope.project.id=7748d2920dac498f818e384b384de2b1, user.id=1fad215896be49bca76dd44ccb1bdb58) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:26.508220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:26.508220 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2aafa-e74a-40f8-8d3d-08932475d0a6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:26.511710 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 452/908] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 23:05:26 2022] GET /identity/v3/role_assignments?user.id=1fad215896be49bca76dd44ccb1bdb58&scope.project.id=7748d2920dac498f818e384b384de2b1&role.id=b808049b0af24ba79f7b5a53a732242d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:28.782031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5cf10-32d3-4d98-856a-9f05468a49f5 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.782632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5cf10-32d3-4d98-856a-9f05468a49f5 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.782738 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5cf10-32d3-4d98-856a-9f05468a49f5 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.784124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 457/909] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:28.789389 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.789803 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.789940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.808173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:28.813468 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:28.840001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:28.876969 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 453/910] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:28 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:28.901103 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5cf10-32d3-4d98-856a-9f05468a49f5 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.008174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5cf10-32d3-4d98-856a-9f05468a49f5 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.015365 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:29.041445 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.042103 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.042418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.042696 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.043321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.044723 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:29.054312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:29.055565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:29.056488 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 458/911] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 23:05:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:29.061615 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.159874 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538b33-641b-47ce-b8f7-e16e29099970 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.193970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.194616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.194913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.195265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.195975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:29.196302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.197707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd0ba-a520-45cd-bab4-698a1d0cba49 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.206807 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 454/912] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:29.212785 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:29.321598 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75808d7-f6de-4f75-81c4-15fd40757da6 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:29.356923 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:29.357538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:29.357816 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:29.358087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] PATH_INFO: `/v3/services` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:29.358799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:29.359100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:29.360452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea14927-0c57-4a99-982b-f3da484012c1 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:29.365164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 459/913] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 23:05:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:31.635375 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b040-5ba4-47a3-8610-f0a2bfac5341 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.636531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b040-5ba4-47a3-8610-f0a2bfac5341 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.636531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b040-5ba4-47a3-8610-f0a2bfac5341 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.637360 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 455/914] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:31.642773 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b0bc-7b8e-4d48-b073-2ca87b86dd98 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.643185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b0bc-7b8e-4d48-b073-2ca87b86dd98 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.643438 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b0bc-7b8e-4d48-b073-2ca87b86dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.662142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-7115b0bc-7b8e-4d48-b073-2ca87b86dd98 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:31.665218 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-7115b0bc-7b8e-4d48-b073-2ca87b86dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:31.690215 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.730107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 460/915] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:31 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:31.754394 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26b040-5ba4-47a3-8610-f0a2bfac5341 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:31.785745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.854992 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26b040-5ba4-47a3-8610-f0a2bfac5341 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:31.889400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb9c65-3d32-4882-8767-ac58c2a100a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:31.890015 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb9c65-3d32-4882-8767-ac58c2a100a2 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:31.890313 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb9c65-3d32-4882-8767-ac58c2a100a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:31.890622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb9c65-3d32-4882-8767-ac58c2a100a2 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:31.891319 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb9c65-3d32-4882-8767-ac58c2a100a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:31.893433 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb9c65-3d32-4882-8767-ac58c2a100a2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:31.996614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 456/916] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 23:05:31 2022] POST /identity/v3/services => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:34.236020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c82694-ab60-4622-b4e5-319b5f5736ca None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.236662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c82694-ab60-4622-b4e5-319b5f5736ca None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.236943 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c82694-ab60-4622-b4e5-319b5f5736ca None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.238395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 461/917] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:34.245551 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.246011 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.249922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.264297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:34.267195 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:34.343440 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 457/918] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:34 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:34.370122 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c82694-ab60-4622-b4e5-319b5f5736ca None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.489375 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c82694-ab60-4622-b4e5-319b5f5736ca None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.528134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.528773 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.529047 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.529317 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.529936 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.531384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:34.545087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:34.546418 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:34.547258 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 462/919] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:34.554048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.573811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:34.662807 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb83d7-a0a7-489b-b2b7-650dcf61926f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.700527 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.701205 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.701431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.701703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.702421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] RBAC: Adding query filter params (name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:34.702725 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.704115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.710025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 458/920] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:34.716623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.750705 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:34.823827 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0678be8-d2b9-4a71-b43a-a512523b37a9 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:34.857045 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:34.857659 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:34.857941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:34.858208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:34.859124 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] RBAC: Adding query filter params (interface=public, service_id=bfc91b114c1f4119986973cee43f56f3, region_id=RegionOne) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:34.859431 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:34.860784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab86c5-b749-4020-848c-b127e3cc5541 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:34.866315 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 463/921] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/endpoints?service_id=bfc91b114c1f4119986973cee43f56f3&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:34.871847 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:34.953960 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:34.971810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41c14e-3dee-4a67-b517-eafec06fabdc None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:35.006663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69dbbc-2576-4b3e-b12b-972e44512b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:35.007211 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69dbbc-2576-4b3e-b12b-972e44512b1e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:35.007488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69dbbc-2576-4b3e-b12b-972e44512b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:35.007760 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69dbbc-2576-4b3e-b12b-972e44512b1e None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:35.008413 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69dbbc-2576-4b3e-b12b-972e44512b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:35.009764 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69dbbc-2576-4b3e-b12b-972e44512b1e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:35.016334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 459/922] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 23:05:34 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:05:37.268023 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b6cb-cb98-4e97-835b-3a69b1613259 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.268672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b6cb-cb98-4e97-835b-3a69b1613259 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.268672 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b6cb-cb98-4e97-835b-3a69b1613259 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.270227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 464/923] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:05:37.278670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d1833-8cf7-435d-b601-342360817361 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.278670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d1833-8cf7-435d-b601-342360817361 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.278670 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d1833-8cf7-435d-b601-342360817361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.294144 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-609d1833-8cf7-435d-b601-342360817361 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:37.295372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-609d1833-8cf7-435d-b601-342360817361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:37.360518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 460/924] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:05:37 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:05:37.385706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b6cb-cb98-4e97-835b-3a69b1613259 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.477168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:37.487107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b6cb-cb98-4e97-835b-3a69b1613259 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.520060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.520678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.520955 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.521226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.521881 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.523223 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:05:37.532015 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:05:37.534726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application with Lock( Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: ERROR keystone.server.flask.application Jul 25 23:05:37.535746 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 465/925] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 23:05:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:05:37.540006 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d1833-8cf7-435d-b601-342360817361 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.615198 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:37.636716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d1833-8cf7-435d-b601-342360817361 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.670622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.671236 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.671513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.671809 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.672481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] RBAC: Adding query filter params (name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:05:37.672785 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.674891 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540814ed-1936-446a-99c4-8a2e5948cadc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:37.679871 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 461/926] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 23:05:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:05:37.685740 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:37.785097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dba199-c350-4f13-ad3f-b1f9d522aad6 None admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:37.818347 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfd60f-f0e6-4e38-8c4c-7c7c3c8dec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:37.818957 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfd60f-f0e6-4e38-8c4c-7c7c3c8dec39 None admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:37.819234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfd60f-f0e6-4e38-8c4c-7c7c3c8dec39 None admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:37.819503 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfd60f-f0e6-4e38-8c4c-7c7c3c8dec39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:37.820196 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfd60f-f0e6-4e38-8c4c-7c7c3c8dec39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:37.821541 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfd60f-f0e6-4e38-8c4c-7c7c3c8dec39 None admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:37.916573 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 466/927] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:05:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:05:47.681666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=30 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:47.911991 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:20.013436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e764b45-4579-49a7-a261-2bd640968bdd None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:20.014426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e764b45-4579-49a7-a261-2bd640968bdd None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:20.014875 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e764b45-4579-49a7-a261-2bd640968bdd None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:20.016501 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 462/928] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:20.022906 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989806-da8c-446b-b17f-fe14d3d7b2ef None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:20.023476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989806-da8c-446b-b17f-fe14d3d7b2ef None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:20.023476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989806-da8c-446b-b17f-fe14d3d7b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:20.107314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-08989806-da8c-446b-b17f-fe14d3d7b2ef None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:20.108523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-08989806-da8c-446b-b17f-fe14d3d7b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:20.228970 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 467/929] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:20.280239 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0a694-0df7-49b9-a782-92ee5e5260c4 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:20.280516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0a694-0df7-49b9-a782-92ee5e5260c4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:20.280825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0a694-0df7-49b9-a782-92ee5e5260c4 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:20.282494 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 463/930] 10.222.0.48 () {54 vars in 965 bytes} [Mon Jul 25 23:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:20.289130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff895-90b3-4358-a733-01ca9510f067 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:20.289130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff895-90b3-4358-a733-01ca9510f067 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:20.289401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff895-90b3-4358-a733-01ca9510f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:20.358014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-de3ff895-90b3-4358-a733-01ca9510f067 None None] MFA Rules not processed for user `95dab827e0eb4f28a7fb0fa414a4bb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:20.368730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-de3ff895-90b3-4358-a733-01ca9510f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:20.408388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:20.441985 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 468/931] 10.222.0.48 () {58 vars in 1062 bytes} [Mon Jul 25 23:12:20 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:20.453026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0a694-0df7-49b9-a782-92ee5e5260c4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:20.464893 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0a694-0df7-49b9-a782-92ee5e5260c4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:20.468601 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ecc4d-64c1-447e-91f1-cb417381deb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:20.469225 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ecc4d-64c1-447e-91f1-cb417381deb3 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:20.469497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ecc4d-64c1-447e-91f1-cb417381deb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:20.469767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ecc4d-64c1-447e-91f1-cb417381deb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:20.480516 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ecc4d-64c1-447e-91f1-cb417381deb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:20.482061 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ecc4d-64c1-447e-91f1-cb417381deb3 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:20.492695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 464/932] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:22.990930 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580ad9-6dd5-4307-8a74-3006cc7f10d9 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:22.991470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580ad9-6dd5-4307-8a74-3006cc7f10d9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:22.991590 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580ad9-6dd5-4307-8a74-3006cc7f10d9 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:22.992952 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 469/933] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:22.998170 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1793-f122-40ca-9113-1ede6183fc77 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:22.998635 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1793-f122-40ca-9113-1ede6183fc77 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:22.998738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1793-f122-40ca-9113-1ede6183fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:23.020230 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f3ab1793-f122-40ca-9113-1ede6183fc77 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:23.021593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f3ab1793-f122-40ca-9113-1ede6183fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:23.029703 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 465/934] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:23.069523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89580ad9-6dd5-4307-8a74-3006cc7f10d9 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:23.080197 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89580ad9-6dd5-4307-8a74-3006cc7f10d9 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:23.084588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb5e80-075d-4d28-b8c4-3067ad9f7387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:23.084588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb5e80-075d-4d28-b8c4-3067ad9f7387 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:23.084588 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb5e80-075d-4d28-b8c4-3067ad9f7387 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:23.084875 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb5e80-075d-4d28-b8c4-3067ad9f7387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:23.093878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb5e80-075d-4d28-b8c4-3067ad9f7387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:23.095192 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb5e80-075d-4d28-b8c4-3067ad9f7387 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:23.106121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 470/935] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:25.844945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1221f3-d09b-4724-ae41-fe093294cae5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:25.845443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1221f3-d09b-4724-ae41-fe093294cae5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:25.845443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1221f3-d09b-4724-ae41-fe093294cae5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:25.846944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 466/936] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:25.852407 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbaa4-43ad-46de-9d03-85b3c707d601 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:25.852790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbaa4-43ad-46de-9d03-85b3c707d601 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:25.852962 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbaa4-43ad-46de-9d03-85b3c707d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:25.913132 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ea9fbaa4-43ad-46de-9d03-85b3c707d601 None None] MFA Rules not processed for user `466bf745aeca4805912f77525bf77d11`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:25.914373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ea9fbaa4-43ad-46de-9d03-85b3c707d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:26.000191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 471/937] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:25 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:26.056833 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2971e-de8d-4859-96d7-47e6b41771fe None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:26.057287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2971e-de8d-4859-96d7-47e6b41771fe None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:26.057667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2971e-de8d-4859-96d7-47e6b41771fe None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:26.059173 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 467/938] 10.222.0.48 () {54 vars in 965 bytes} [Mon Jul 25 23:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:12:26.065318 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5867be-374e-4321-9473-d9f7c29c7aa9 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:26.065613 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5867be-374e-4321-9473-d9f7c29c7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:26.066042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5867be-374e-4321-9473-d9f7c29c7aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:26.087139 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-fa5867be-374e-4321-9473-d9f7c29c7aa9 None None] MFA Rules not processed for user `95dab827e0eb4f28a7fb0fa414a4bb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:26.088360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-fa5867be-374e-4321-9473-d9f7c29c7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:26.095164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 472/939] 10.222.0.48 () {58 vars in 1062 bytes} [Mon Jul 25 23:12:26 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:26.104878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2971e-de8d-4859-96d7-47e6b41771fe None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:26.115704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2971e-de8d-4859-96d7-47e6b41771fe None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:26.119377 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c64cd-d4c5-4c9a-92ab-57371fe18e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:26.119818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c64cd-d4c5-4c9a-92ab-57371fe18e1a service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:26.120093 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c64cd-d4c5-4c9a-92ab-57371fe18e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:26.120363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c64cd-d4c5-4c9a-92ab-57371fe18e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:26.129813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c64cd-d4c5-4c9a-92ab-57371fe18e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:26.131363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c64cd-d4c5-4c9a-92ab-57371fe18e1a service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:26.141348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 468/940] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:26 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:29.630150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a37443-bd7d-4c76-b5ea-28b635ef59a6 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:29.630801 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a37443-bd7d-4c76-b5ea-28b635ef59a6 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:29.630895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a37443-bd7d-4c76-b5ea-28b635ef59a6 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:29.632227 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 473/941] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:29.637503 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996069f8-d503-41e1-af7c-c39cf476b53b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:29.637896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996069f8-d503-41e1-af7c-c39cf476b53b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:29.638059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996069f8-d503-41e1-af7c-c39cf476b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:29.657098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-996069f8-d503-41e1-af7c-c39cf476b53b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:29.658318 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-996069f8-d503-41e1-af7c-c39cf476b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:29.730446 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 469/942] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:29 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:29.770636 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a37443-bd7d-4c76-b5ea-28b635ef59a6 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:29.781285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a37443-bd7d-4c76-b5ea-28b635ef59a6 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:29.784771 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a92e-97a8-46e3-88ed-ca25b3191c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:29.785371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a92e-97a8-46e3-88ed-ca25b3191c40 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:29.785654 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a92e-97a8-46e3-88ed-ca25b3191c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:29.786069 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a92e-97a8-46e3-88ed-ca25b3191c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:29.794879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a92e-97a8-46e3-88ed-ca25b3191c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:29.796296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a92e-97a8-46e3-88ed-ca25b3191c40 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:29.805966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 474/943] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:29 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:33.185553 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243e607-e15c-49b4-bd7f-306389d5068a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:33.186138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243e607-e15c-49b4-bd7f-306389d5068a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:33.186138 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243e607-e15c-49b4-bd7f-306389d5068a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:33.187643 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 470/944] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:33.192730 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a0be1-8546-4ba8-955d-812bf7a8e603 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:33.193126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a0be1-8546-4ba8-955d-812bf7a8e603 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:33.193293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a0be1-8546-4ba8-955d-812bf7a8e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:33.212595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-773a0be1-8546-4ba8-955d-812bf7a8e603 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:33.213787 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-773a0be1-8546-4ba8-955d-812bf7a8e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:33.221605 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 475/945] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:33.260174 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243e607-e15c-49b4-bd7f-306389d5068a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:33.272331 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243e607-e15c-49b4-bd7f-306389d5068a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:33.280108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba010a-1670-4d54-9dd9-2b809d2f68f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:33.280108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba010a-1670-4d54-9dd9-2b809d2f68f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:33.280108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba010a-1670-4d54-9dd9-2b809d2f68f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:33.280108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba010a-1670-4d54-9dd9-2b809d2f68f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:33.287466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba010a-1670-4d54-9dd9-2b809d2f68f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:33.288892 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba010a-1670-4d54-9dd9-2b809d2f68f1 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:33.298613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 471/946] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:35.649396 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938b53-815b-4d78-90be-fb32cbf9e88e None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:35.649933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938b53-815b-4d78-90be-fb32cbf9e88e None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:35.649933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938b53-815b-4d78-90be-fb32cbf9e88e None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:35.651301 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 476/947] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:35.656682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590373-4aeb-4858-a866-6a7bb3c9f468 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:35.657128 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590373-4aeb-4858-a866-6a7bb3c9f468 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:35.657221 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a590373-4aeb-4858-a866-6a7bb3c9f468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:35.676936 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6a590373-4aeb-4858-a866-6a7bb3c9f468 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:35.678123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6a590373-4aeb-4858-a866-6a7bb3c9f468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:35.685750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 472/948] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:35.724268 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938b53-815b-4d78-90be-fb32cbf9e88e None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:35.734867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938b53-815b-4d78-90be-fb32cbf9e88e None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:35.738351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d85474-ba73-4e29-82ef-b76c0de724d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:35.739012 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d85474-ba73-4e29-82ef-b76c0de724d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:35.739291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d85474-ba73-4e29-82ef-b76c0de724d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:35.739572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d85474-ba73-4e29-82ef-b76c0de724d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:35.748300 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d85474-ba73-4e29-82ef-b76c0de724d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:35.749703 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d85474-ba73-4e29-82ef-b76c0de724d0 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:35.759002 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 477/949] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:38.047114 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a982fa-00c2-445d-8066-95f570529243 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:38.047708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a982fa-00c2-445d-8066-95f570529243 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:38.047708 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a982fa-00c2-445d-8066-95f570529243 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:38.049010 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 473/950] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:38.054415 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c2ee-2d97-469d-8db8-361eae810ed1 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:38.054845 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c2ee-2d97-469d-8db8-361eae810ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:38.054974 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c2ee-2d97-469d-8db8-361eae810ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:38.073797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-4f04c2ee-2d97-469d-8db8-361eae810ed1 None None] MFA Rules not processed for user `466bf745aeca4805912f77525bf77d11`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:38.075049 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-4f04c2ee-2d97-469d-8db8-361eae810ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:38.083174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 478/951] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:38 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:38.122200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a982fa-00c2-445d-8066-95f570529243 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:38.132845 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a982fa-00c2-445d-8066-95f570529243 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:38.136287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a714f8-14c4-4ff3-bcf2-5e9fb5b0938b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:38.136889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a714f8-14c4-4ff3-bcf2-5e9fb5b0938b service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:38.137167 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a714f8-14c4-4ff3-bcf2-5e9fb5b0938b service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:38.137437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a714f8-14c4-4ff3-bcf2-5e9fb5b0938b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:38.147192 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a714f8-14c4-4ff3-bcf2-5e9fb5b0938b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:38.148606 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a714f8-14c4-4ff3-bcf2-5e9fb5b0938b service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:38.158048 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 474/952] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:38 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:40.916347 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba50bc-c35a-4634-9b54-adf1c125fd71 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:40.916881 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba50bc-c35a-4634-9b54-adf1c125fd71 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:40.916881 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba50bc-c35a-4634-9b54-adf1c125fd71 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:40.918190 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 479/953] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:40.923854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e920a0-ca54-46ac-a4b0-ffea530ac0ec None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:40.924403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e920a0-ca54-46ac-a4b0-ffea530ac0ec None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:40.924403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e920a0-ca54-46ac-a4b0-ffea530ac0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:40.945074 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-91e920a0-ca54-46ac-a4b0-ffea530ac0ec None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:40.946307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-91e920a0-ca54-46ac-a4b0-ffea530ac0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:40.954256 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 475/954] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:40.991775 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba50bc-c35a-4634-9b54-adf1c125fd71 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:41.002387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba50bc-c35a-4634-9b54-adf1c125fd71 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:41.006724 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ac29-d3a1-4f58-8953-8d8899da6b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:41.007331 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ac29-d3a1-4f58-8953-8d8899da6b71 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:41.007610 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ac29-d3a1-4f58-8953-8d8899da6b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:41.007884 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ac29-d3a1-4f58-8953-8d8899da6b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:41.016825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ac29-d3a1-4f58-8953-8d8899da6b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:41.018243 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ac29-d3a1-4f58-8953-8d8899da6b71 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:41.028793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 480/955] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:43.358646 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2220-361a-4d6e-9ccf-5fe096f0a418 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:43.359164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2220-361a-4d6e-9ccf-5fe096f0a418 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:43.359164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2220-361a-4d6e-9ccf-5fe096f0a418 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:43.360526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 476/956] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:43.366843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb10557-5f09-4c07-8485-aeb10565cd25 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:43.367342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb10557-5f09-4c07-8485-aeb10565cd25 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:43.367433 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb10557-5f09-4c07-8485-aeb10565cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:43.377830 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:43.388437 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-4eb10557-5f09-4c07-8485-aeb10565cd25 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:43.389674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-4eb10557-5f09-4c07-8485-aeb10565cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:43.397832 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 481/957] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:43.439987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2220-361a-4d6e-9ccf-5fe096f0a418 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:43.450865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2220-361a-4d6e-9ccf-5fe096f0a418 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:43.455667 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419440-aaf7-42da-ba04-7a24194419e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:43.456400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419440-aaf7-42da-ba04-7a24194419e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:43.456756 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419440-aaf7-42da-ba04-7a24194419e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:43.457107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419440-aaf7-42da-ba04-7a24194419e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:43.466966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419440-aaf7-42da-ba04-7a24194419e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:43.468383 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419440-aaf7-42da-ba04-7a24194419e9 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:43.478412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 477/958] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:46.352890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cddde-dd3d-4882-be4b-5d175f02ae27 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:46.353427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cddde-dd3d-4882-be4b-5d175f02ae27 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:46.353427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cddde-dd3d-4882-be4b-5d175f02ae27 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:46.354818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 482/959] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:46.359950 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68b519-41e2-43e7-ab36-14accd054ad3 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:46.360382 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68b519-41e2-43e7-ab36-14accd054ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:46.360490 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68b519-41e2-43e7-ab36-14accd054ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:46.379029 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-ae68b519-41e2-43e7-ab36-14accd054ad3 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:46.380848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-ae68b519-41e2-43e7-ab36-14accd054ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:46.388502 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 478/960] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:46 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:46.425472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cddde-dd3d-4882-be4b-5d175f02ae27 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:46.438216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cddde-dd3d-4882-be4b-5d175f02ae27 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:46.444095 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf41b-a147-41cc-ad8d-5abff14cd453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:46.444697 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf41b-a147-41cc-ad8d-5abff14cd453 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:46.444977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf41b-a147-41cc-ad8d-5abff14cd453 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:46.445249 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf41b-a147-41cc-ad8d-5abff14cd453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:46.454167 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf41b-a147-41cc-ad8d-5abff14cd453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:46.455635 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf41b-a147-41cc-ad8d-5abff14cd453 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:46.465376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 483/961] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:46 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:50.955168 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2119b77-3bc5-4db1-a6c3-049b6a1a8987 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:50.955715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2119b77-3bc5-4db1-a6c3-049b6a1a8987 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:50.955715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2119b77-3bc5-4db1-a6c3-049b6a1a8987 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:50.957076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 479/962] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:50.963052 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8ebb6-8bc3-4b8c-af24-f4438ac634d8 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:50.963463 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8ebb6-8bc3-4b8c-af24-f4438ac634d8 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:50.963609 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8ebb6-8bc3-4b8c-af24-f4438ac634d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:50.984564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9dc8ebb6-8bc3-4b8c-af24-f4438ac634d8 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:50.985917 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9dc8ebb6-8bc3-4b8c-af24-f4438ac634d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:51.010271 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 484/963] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:51.036400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2119b77-3bc5-4db1-a6c3-049b6a1a8987 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:51.042344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=74 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:51.048039 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2119b77-3bc5-4db1-a6c3-049b6a1a8987 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:51.052865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdc00f-3b69-428d-ba76-2e341bbbb80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:51.053580 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdc00f-3b69-428d-ba76-2e341bbbb80e service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:51.054374 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdc00f-3b69-428d-ba76-2e341bbbb80e service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:51.054374 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdc00f-3b69-428d-ba76-2e341bbbb80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:51.063443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdc00f-3b69-428d-ba76-2e341bbbb80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:51.064859 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdc00f-3b69-428d-ba76-2e341bbbb80e service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:51.074793 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 480/964] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:54.255628 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc09bf-6052-4eba-96d4-f3720ade65f9 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:54.256183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc09bf-6052-4eba-96d4-f3720ade65f9 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:54.256183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc09bf-6052-4eba-96d4-f3720ade65f9 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:54.257592 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 485/965] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:54.263164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3260b63-89a7-4414-8492-1d0de9c0186c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:54.264652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3260b63-89a7-4414-8492-1d0de9c0186c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:54.264652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3260b63-89a7-4414-8492-1d0de9c0186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:54.283108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a3260b63-89a7-4414-8492-1d0de9c0186c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:54.284301 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a3260b63-89a7-4414-8492-1d0de9c0186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:54.292837 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 481/966] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:54 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:54.332711 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc09bf-6052-4eba-96d4-f3720ade65f9 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:54.344107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc09bf-6052-4eba-96d4-f3720ade65f9 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:54.348491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00f7ca-db02-40c0-97b0-3471689d3b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:54.349118 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00f7ca-db02-40c0-97b0-3471689d3b51 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:54.349381 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00f7ca-db02-40c0-97b0-3471689d3b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:54.349660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00f7ca-db02-40c0-97b0-3471689d3b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:54.359027 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00f7ca-db02-40c0-97b0-3471689d3b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:54.360447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00f7ca-db02-40c0-97b0-3471689d3b51 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:54.371128 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 486/967] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:54 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:12:58.858403 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5736-92d7-4291-aa88-7b57e422f01f None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:58.858839 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5736-92d7-4291-aa88-7b57e422f01f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:58.858964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5736-92d7-4291-aa88-7b57e422f01f None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:58.860332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 482/968] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:12:58.865796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc7152-c548-478d-be30-10dadc485049 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:58.866249 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc7152-c548-478d-be30-10dadc485049 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:58.866512 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc7152-c548-478d-be30-10dadc485049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:58.887071 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e7bc7152-c548-478d-be30-10dadc485049 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:12:58.888274 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e7bc7152-c548-478d-be30-10dadc485049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:12:58.896862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 487/969] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:12:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:12:58.935125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5736-92d7-4291-aa88-7b57e422f01f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:12:58.946313 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5736-92d7-4291-aa88-7b57e422f01f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:12:58.949820 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45512b0-85b5-48f6-9481-2baed459f478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:12:58.950466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45512b0-85b5-48f6-9481-2baed459f478 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:12:58.950747 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45512b0-85b5-48f6-9481-2baed459f478 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:12:58.951019 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45512b0-85b5-48f6-9481-2baed459f478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:12:58.961040 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45512b0-85b5-48f6-9481-2baed459f478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:12:58.962493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45512b0-85b5-48f6-9481-2baed459f478 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:12:58.971824 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 483/970] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:12:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:04.507321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293751-ac53-4f95-9383-40618cb9fc3c None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:04.508350 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293751-ac53-4f95-9383-40618cb9fc3c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:04.508829 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293751-ac53-4f95-9383-40618cb9fc3c None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:04.510770 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 488/971] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:04.518426 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98079e6-1ce6-4fed-a87d-88a36548110a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:04.519228 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98079e6-1ce6-4fed-a87d-88a36548110a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:04.520007 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98079e6-1ce6-4fed-a87d-88a36548110a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:04.588268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b98079e6-1ce6-4fed-a87d-88a36548110a None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:04.588268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b98079e6-1ce6-4fed-a87d-88a36548110a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:04.679723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 484/972] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:13:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:08.882213 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=20 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:09.186604 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368a3e-6c6a-4d90-b762-6fc2c8a5f7ac None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:09.187209 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368a3e-6c6a-4d90-b762-6fc2c8a5f7ac None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:09.187599 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368a3e-6c6a-4d90-b762-6fc2c8a5f7ac None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:09.189070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 489/973] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:09.195745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8b3-005b-4ad7-88d5-dfe7f0d60940 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:09.196576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8b3-005b-4ad7-88d5-dfe7f0d60940 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:09.197063 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8b3-005b-4ad7-88d5-dfe7f0d60940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:09.218115 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-deefa8b3-005b-4ad7-88d5-dfe7f0d60940 None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:09.219368 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-deefa8b3-005b-4ad7-88d5-dfe7f0d60940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:09.228843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 485/974] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:13:09 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:10.656393 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb261-0eb0-4d3e-90f1-567f18aa6423 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:10.656914 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb261-0eb0-4d3e-90f1-567f18aa6423 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:10.656914 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb261-0eb0-4d3e-90f1-567f18aa6423 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:10.658313 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 490/975] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:10.663325 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d2f69-5e8f-4b5f-9a82-cc7163fef55d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:10.663740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d2f69-5e8f-4b5f-9a82-cc7163fef55d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:10.663880 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d2f69-5e8f-4b5f-9a82-cc7163fef55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:10.683929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-776d2f69-5e8f-4b5f-9a82-cc7163fef55d None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:10.685241 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-776d2f69-5e8f-4b5f-9a82-cc7163fef55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:10.694458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 486/976] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:13:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:14.718445 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf32096-a402-4b24-bb55-d1e4698ad7b1 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:14.719013 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf32096-a402-4b24-bb55-d1e4698ad7b1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:14.719013 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf32096-a402-4b24-bb55-d1e4698ad7b1 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:14.720581 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 491/977] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:14.726618 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb064ba0-543f-436b-92a4-352c50cb12e6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:14.727044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb064ba0-543f-436b-92a4-352c50cb12e6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:14.727157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb064ba0-543f-436b-92a4-352c50cb12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:14.747908 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-bb064ba0-543f-436b-92a4-352c50cb12e6 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:14.749097 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-bb064ba0-543f-436b-92a4-352c50cb12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:14.757224 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 487/978] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:14.813374 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c229d5-8fb2-4e3b-be05-b5045a717061 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:14.814017 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c229d5-8fb2-4e3b-be05-b5045a717061 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:14.815355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c229d5-8fb2-4e3b-be05-b5045a717061 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:14.817279 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 492/979] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 23:13:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:14.825204 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f5f0-e94e-4906-a398-980358c9e79b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:14.826088 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f5f0-e94e-4906-a398-980358c9e79b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:14.826784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f5f0-e94e-4906-a398-980358c9e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:14.882674 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2079f5f0-e94e-4906-a398-980358c9e79b None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:14.883978 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2079f5f0-e94e-4906-a398-980358c9e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:14.944676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:14.978682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 488/980] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 23:13:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:13:14.981450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c229d5-8fb2-4e3b-be05-b5045a717061 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:14.997735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c229d5-8fb2-4e3b-be05-b5045a717061 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:15.002987 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc6f59-a172-41df-900a-e3e217197e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:15.004543 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6f59-a172-41df-900a-e3e217197e7e service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:15.004835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6f59-a172-41df-900a-e3e217197e7e service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:15.005116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6f59-a172-41df-900a-e3e217197e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:15.014749 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6f59-a172-41df-900a-e3e217197e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:15.016419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6f59-a172-41df-900a-e3e217197e7e service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:15.033947 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 493/981] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:17.528062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dfa2c-cb18-4642-9296-a270609b4dfe None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:17.528612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dfa2c-cb18-4642-9296-a270609b4dfe None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:17.528612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dfa2c-cb18-4642-9296-a270609b4dfe None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:17.530355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 489/982] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:17.535530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26660-22c1-4f4f-9ae5-65525245fa66 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:17.536108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26660-22c1-4f4f-9ae5-65525245fa66 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:17.536108 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26660-22c1-4f4f-9ae5-65525245fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:17.556546 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-5be26660-22c1-4f4f-9ae5-65525245fa66 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:17.561082 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-5be26660-22c1-4f4f-9ae5-65525245fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:17.571462 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 494/983] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:17.619729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dfa2c-cb18-4642-9296-a270609b4dfe None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:17.633485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dfa2c-cb18-4642-9296-a270609b4dfe None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:17.638894 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bcaae-8818-4d63-a330-2d7e35fe9c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:17.639530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bcaae-8818-4d63-a330-2d7e35fe9c80 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:17.639808 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bcaae-8818-4d63-a330-2d7e35fe9c80 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:17.640079 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bcaae-8818-4d63-a330-2d7e35fe9c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:17.648976 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bcaae-8818-4d63-a330-2d7e35fe9c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:17.650612 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bcaae-8818-4d63-a330-2d7e35fe9c80 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:17.661162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 490/984] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:20.448642 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b4dd-723d-46fd-aa07-9be8e11f51f1 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:20.449182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b4dd-723d-46fd-aa07-9be8e11f51f1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:20.449182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b4dd-723d-46fd-aa07-9be8e11f51f1 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:20.450715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 495/985] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:20.455661 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853bf0-d1e4-4741-943b-f07435114c19 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:20.456123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853bf0-d1e4-4741-943b-f07435114c19 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:20.456214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f853bf0-d1e4-4741-943b-f07435114c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:20.474934 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9f853bf0-d1e4-4741-943b-f07435114c19 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:20.476112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9f853bf0-d1e4-4741-943b-f07435114c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:20.483763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 491/986] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:20.530565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee376664-34f1-4292-bcab-46ad635d0672 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:20.530854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee376664-34f1-4292-bcab-46ad635d0672 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:20.531133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee376664-34f1-4292-bcab-46ad635d0672 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:20.532502 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 496/987] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 23:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:20.538729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a7f6-ecbd-4a28-ac57-b2bf10875ac4 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:20.539072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a7f6-ecbd-4a28-ac57-b2bf10875ac4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:20.539359 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a7f6-ecbd-4a28-ac57-b2bf10875ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:20.559799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-44c7a7f6-ecbd-4a28-ac57-b2bf10875ac4 None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:20.560994 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-44c7a7f6-ecbd-4a28-ac57-b2bf10875ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:20.570346 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 492/988] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 23:13:20 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:13:20.578233 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee376664-34f1-4292-bcab-46ad635d0672 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:20.593205 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee376664-34f1-4292-bcab-46ad635d0672 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:20.598831 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c877c7d-66da-44b7-a774-5f8833d735ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:20.599451 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877c7d-66da-44b7-a774-5f8833d735ee service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:20.599731 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877c7d-66da-44b7-a774-5f8833d735ee service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:20.600005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c877c7d-66da-44b7-a774-5f8833d735ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:20.608356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c877c7d-66da-44b7-a774-5f8833d735ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:20.609921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c877c7d-66da-44b7-a774-5f8833d735ee service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:20.620641 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 497/989] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:23.117255 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7485a-1b1a-46c4-b0ef-db94311b63b6 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:23.117855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7485a-1b1a-46c4-b0ef-db94311b63b6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:23.117855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7485a-1b1a-46c4-b0ef-db94311b63b6 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:23.119425 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 493/990] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:23.124935 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97438b-7fd1-4834-bc6e-bbbe7767cfed None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:23.125720 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97438b-7fd1-4834-bc6e-bbbe7767cfed None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:23.126172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97438b-7fd1-4834-bc6e-bbbe7767cfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:23.146656 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ba97438b-7fd1-4834-bc6e-bbbe7767cfed None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:23.148085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ba97438b-7fd1-4834-bc6e-bbbe7767cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:23.166583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 498/991] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:13:23.204878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7485a-1b1a-46c4-b0ef-db94311b63b6 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:23.224122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7485a-1b1a-46c4-b0ef-db94311b63b6 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:23.229549 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99a63a-a101-42f9-9f51-92616dc4f891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:23.230625 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99a63a-a101-42f9-9f51-92616dc4f891 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:23.231053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99a63a-a101-42f9-9f51-92616dc4f891 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:23.231476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99a63a-a101-42f9-9f51-92616dc4f891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:23.242020 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99a63a-a101-42f9-9f51-92616dc4f891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:23.244140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99a63a-a101-42f9-9f51-92616dc4f891 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:23.257303 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 494/992] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:24.864872 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e182-56f8-4250-a930-948957a7de40 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:24.866042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e182-56f8-4250-a930-948957a7de40 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:24.866675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e182-56f8-4250-a930-948957a7de40 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:24.877134 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ce099-df20-4a7d-9511-86b55875ae4b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:24.878982 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ce099-df20-4a7d-9511-86b55875ae4b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:24.879786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ce099-df20-4a7d-9511-86b55875ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:24.882968 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 499/993] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:24 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:24.913025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b34ce099-df20-4a7d-9511-86b55875ae4b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:24.914686 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b34ce099-df20-4a7d-9511-86b55875ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:24.947276 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 495/994] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:25.274369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480213-2125-46a4-9ee2-969306ae1108 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:25.274369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480213-2125-46a4-9ee2-969306ae1108 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:25.274369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480213-2125-46a4-9ee2-969306ae1108 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:25.274369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 500/995] 10.222.0.48 () {54 vars in 964 bytes} [Mon Jul 25 23:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:25.278140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb1ad-8b41-46e3-a10d-419e1de30707 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:25.278484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb1ad-8b41-46e3-a10d-419e1de30707 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:25.278766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb1ad-8b41-46e3-a10d-419e1de30707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:25.334925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6f4cb1ad-8b41-46e3-a10d-419e1de30707 None None] MFA Rules not processed for user `240ff8f23838441aa25ca1cf766c7014`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:25.336142 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6f4cb1ad-8b41-46e3-a10d-419e1de30707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:25.403194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 496/996] 10.222.0.48 () {58 vars in 1061 bytes} [Mon Jul 25 23:13:25 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:25.411374 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480213-2125-46a4-9ee2-969306ae1108 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:25.422462 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480213-2125-46a4-9ee2-969306ae1108 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:25.426814 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf0b9-b72e-4c04-ae7a-54b2af7a6ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240ff8f23838441aa25ca1cf766c7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:25.427667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf0b9-b72e-4c04-ae7a-54b2af7a6ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:25.428154 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf0b9-b72e-4c04-ae7a-54b2af7a6ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:25.428632 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf0b9-b72e-4c04-ae7a-54b2af7a6ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:25.439126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf0b9-b72e-4c04-ae7a-54b2af7a6ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:25.440755 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf0b9-b72e-4c04-ae7a-54b2af7a6ae6 service cinder] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:25.450956 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 501/997] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:25.757034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3aeb-25ca-47a9-a239-e07ee0eb506a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:25.757320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3aeb-25ca-47a9-a239-e07ee0eb506a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:25.757811 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3aeb-25ca-47a9-a239-e07ee0eb506a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:25.759567 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 497/998] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:25.764652 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139660aa-99eb-4c58-9fce-47d9771af372 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:25.764946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139660aa-99eb-4c58-9fce-47d9771af372 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:25.765221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139660aa-99eb-4c58-9fce-47d9771af372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:25.784820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-139660aa-99eb-4c58-9fce-47d9771af372 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:25.786382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-139660aa-99eb-4c58-9fce-47d9771af372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:25.795695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 502/999] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:25.841652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3aeb-25ca-47a9-a239-e07ee0eb506a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:25.856261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3aeb-25ca-47a9-a239-e07ee0eb506a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:25.861062 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0031-7d2b-4424-8213-4ccf1c2bb62e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:25.861678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0031-7d2b-4424-8213-4ccf1c2bb62e service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:25.861966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0031-7d2b-4424-8213-4ccf1c2bb62e service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:25.862248 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0031-7d2b-4424-8213-4ccf1c2bb62e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:25.871374 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0031-7d2b-4424-8213-4ccf1c2bb62e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:25.872962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0031-7d2b-4424-8213-4ccf1c2bb62e service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:25.883624 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 498/1000] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:28.344151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cfe41-daf4-4f7e-ba07-99a5233893e8 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:28.344643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cfe41-daf4-4f7e-ba07-99a5233893e8 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:28.344643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cfe41-daf4-4f7e-ba07-99a5233893e8 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:28.346150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 503/1001] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:28.352366 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496496a-3708-4c1c-8588-866a784dc574 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:28.352837 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496496a-3708-4c1c-8588-866a784dc574 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:28.352943 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496496a-3708-4c1c-8588-866a784dc574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:28.372696 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1496496a-3708-4c1c-8588-866a784dc574 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:28.373883 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1496496a-3708-4c1c-8588-866a784dc574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:28.381609 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 499/1002] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:28.427116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cfe41-daf4-4f7e-ba07-99a5233893e8 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:28.440344 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cfe41-daf4-4f7e-ba07-99a5233893e8 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:28.445482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7d43a-a799-42c7-a7b1-6eb87c690c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:28.446087 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7d43a-a799-42c7-a7b1-6eb87c690c3b service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:28.446401 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7d43a-a799-42c7-a7b1-6eb87c690c3b service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:28.446675 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7d43a-a799-42c7-a7b1-6eb87c690c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:28.454972 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7d43a-a799-42c7-a7b1-6eb87c690c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:28.457356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7d43a-a799-42c7-a7b1-6eb87c690c3b service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:28.466583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 504/1003] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:30.864444 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35720f9-4f43-46f2-801b-3aec9772fe49 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:30.864952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35720f9-4f43-46f2-801b-3aec9772fe49 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:30.864952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35720f9-4f43-46f2-801b-3aec9772fe49 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:30.866268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 500/1004] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:30.871490 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1cb79-143e-422d-ab39-94375182c560 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:30.871902 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1cb79-143e-422d-ab39-94375182c560 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:30.872047 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1cb79-143e-422d-ab39-94375182c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:30.891593 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-86e1cb79-143e-422d-ab39-94375182c560 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:30.892794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-86e1cb79-143e-422d-ab39-94375182c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:30.902818 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 505/1005] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:30.947305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35720f9-4f43-46f2-801b-3aec9772fe49 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:30.961903 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35720f9-4f43-46f2-801b-3aec9772fe49 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:30.967389 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2abb-940d-4c72-9fd6-a2c08eaee205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:30.967990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2abb-940d-4c72-9fd6-a2c08eaee205 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:30.968265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2abb-940d-4c72-9fd6-a2c08eaee205 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:30.968538 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2abb-940d-4c72-9fd6-a2c08eaee205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:30.977910 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2abb-940d-4c72-9fd6-a2c08eaee205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:30.979490 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2abb-940d-4c72-9fd6-a2c08eaee205 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:30.989344 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 501/1006] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:33.276877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c9a0-e6b7-4fe8-b1b8-9b5f2cbb46f4 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.277447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c9a0-e6b7-4fe8-b1b8-9b5f2cbb46f4 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.277530 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c9a0-e6b7-4fe8-b1b8-9b5f2cbb46f4 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.278860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 506/1007] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:33.284435 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428ef8-61fb-4be0-aba5-9eebf242514b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.285333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428ef8-61fb-4be0-aba5-9eebf242514b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.285333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428ef8-61fb-4be0-aba5-9eebf242514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.305231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-51428ef8-61fb-4be0-aba5-9eebf242514b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:33.306466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-51428ef8-61fb-4be0-aba5-9eebf242514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:33.314456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 502/1008] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:33.360723 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2c9a0-e6b7-4fe8-b1b8-9b5f2cbb46f4 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:33.375142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2c9a0-e6b7-4fe8-b1b8-9b5f2cbb46f4 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:33.380234 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22b39-b5ad-4012-ad34-2ed56628c69d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:33.380840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22b39-b5ad-4012-ad34-2ed56628c69d service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:33.381121 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22b39-b5ad-4012-ad34-2ed56628c69d service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:33.381395 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22b39-b5ad-4012-ad34-2ed56628c69d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:33.389483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf22b39-b5ad-4012-ad34-2ed56628c69d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:33.404449 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf22b39-b5ad-4012-ad34-2ed56628c69d service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:33.404449 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 507/1009] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:36.044607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1432a-36cd-42ab-8d7c-461357ca40ba None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:36.044607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1432a-36cd-42ab-8d7c-461357ca40ba None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:36.044607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1432a-36cd-42ab-8d7c-461357ca40ba None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:36.044607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 503/1010] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:36.052899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966b12d-ed53-4e7d-9c24-449eb2fc757c None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:36.052899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966b12d-ed53-4e7d-9c24-449eb2fc757c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:36.052899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966b12d-ed53-4e7d-9c24-449eb2fc757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:36.052899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-2966b12d-ed53-4e7d-9c24-449eb2fc757c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:36.052899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-2966b12d-ed53-4e7d-9c24-449eb2fc757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:36.052899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 508/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:36.053716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1432a-36cd-42ab-8d7c-461357ca40ba None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:36.053716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1432a-36cd-42ab-8d7c-461357ca40ba None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:36.053716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3badee-f43d-4f02-bdab-114ee16fc0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:36.053716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3badee-f43d-4f02-bdab-114ee16fc0d9 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:36.054027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3badee-f43d-4f02-bdab-114ee16fc0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:36.054027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3badee-f43d-4f02-bdab-114ee16fc0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:36.054027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3badee-f43d-4f02-bdab-114ee16fc0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:36.054027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3badee-f43d-4f02-bdab-114ee16fc0d9 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:36.056893 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 504/1012] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:40.316110 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d101e-113b-486b-a52c-b159f58354c1 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:40.316778 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d101e-113b-486b-a52c-b159f58354c1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:40.316778 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d101e-113b-486b-a52c-b159f58354c1 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:40.318171 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 509/1013] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:40.323979 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7eba0-830d-4bbb-869e-4e1d1f36b37b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:40.324485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7eba0-830d-4bbb-869e-4e1d1f36b37b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:40.324593 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7eba0-830d-4bbb-869e-4e1d1f36b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:40.345841 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9cd7eba0-830d-4bbb-869e-4e1d1f36b37b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:40.347140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9cd7eba0-830d-4bbb-869e-4e1d1f36b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:40.355560 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 505/1014] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:40.403531 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d101e-113b-486b-a52c-b159f58354c1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:40.411637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=46 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:40.418184 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d101e-113b-486b-a52c-b159f58354c1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:40.423491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff745d-aaf2-48c5-8775-5728b2ad2ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:40.424174 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff745d-aaf2-48c5-8775-5728b2ad2ea9 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:40.424499 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff745d-aaf2-48c5-8775-5728b2ad2ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:40.424782 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff745d-aaf2-48c5-8775-5728b2ad2ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:40.434582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff745d-aaf2-48c5-8775-5728b2ad2ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:40.436210 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff745d-aaf2-48c5-8775-5728b2ad2ea9 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:40.447166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 510/1015] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:41.925480 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ba6b-630b-4e2d-8c4b-e201890c51ce None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:41.926037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ba6b-630b-4e2d-8c4b-e201890c51ce None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:41.926037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923ba6b-630b-4e2d-8c4b-e201890c51ce None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:41.927350 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 506/1016] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:41.932697 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259c0a-49ba-4001-a6a2-cb7d8f5d5b98 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:41.933165 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259c0a-49ba-4001-a6a2-cb7d8f5d5b98 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:41.933271 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259c0a-49ba-4001-a6a2-cb7d8f5d5b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:41.952965 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-38259c0a-49ba-4001-a6a2-cb7d8f5d5b98 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:41.954152 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-38259c0a-49ba-4001-a6a2-cb7d8f5d5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:41.962483 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 511/1017] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:42.019024 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2896b-2fc3-4b00-a4ff-1948aa656509 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:42.019416 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2896b-2fc3-4b00-a4ff-1948aa656509 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:42.019695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2896b-2fc3-4b00-a4ff-1948aa656509 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:42.021025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 507/1018] 10.222.0.48 () {54 vars in 966 bytes} [Mon Jul 25 23:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:42.026097 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d14e6-fbbc-4d7a-a39e-04354b15d75a None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:42.026552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d14e6-fbbc-4d7a-a39e-04354b15d75a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:42.026914 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d14e6-fbbc-4d7a-a39e-04354b15d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:42.076212 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9a8d14e6-fbbc-4d7a-a39e-04354b15d75a None None] MFA Rules not processed for user `b422d3c782ae4b86a3af62a83b2a6489`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:42.077396 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9a8d14e6-fbbc-4d7a-a39e-04354b15d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:42.137633 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 512/1019] 10.222.0.48 () {58 vars in 1063 bytes} [Mon Jul 25 23:13:42 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:42.145449 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2896b-2fc3-4b00-a4ff-1948aa656509 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:42.156107 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2896b-2fc3-4b00-a4ff-1948aa656509 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:42.159805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196dfc7-05ea-4ba1-96aa-d045e1991ae2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b422d3c782ae4b86a3af62a83b2a6489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:42.160478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196dfc7-05ea-4ba1-96aa-d045e1991ae2 service glance] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:42.160826 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196dfc7-05ea-4ba1-96aa-d045e1991ae2 service glance] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:42.161169 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196dfc7-05ea-4ba1-96aa-d045e1991ae2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:42.169980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196dfc7-05ea-4ba1-96aa-d045e1991ae2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:42.171522 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196dfc7-05ea-4ba1-96aa-d045e1991ae2 service glance] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:42.181724 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 508/1020] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:42.854464 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2b78-4152-44ee-a7b1-29fe96b07647 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:42.854703 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2b78-4152-44ee-a7b1-29fe96b07647 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:42.854941 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2b78-4152-44ee-a7b1-29fe96b07647 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:42.856296 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 513/1021] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:42.861359 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36712ae-6331-4ea7-99da-a571943bf83d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:42.866400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36712ae-6331-4ea7-99da-a571943bf83d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:42.866400 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36712ae-6331-4ea7-99da-a571943bf83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:42.870402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:42.880650 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a36712ae-6331-4ea7-99da-a571943bf83d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:42.881847 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a36712ae-6331-4ea7-99da-a571943bf83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:42.890573 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 509/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:42.938651 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab2b78-4152-44ee-a7b1-29fe96b07647 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:42.960985 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab2b78-4152-44ee-a7b1-29fe96b07647 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:42.966152 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f4b6b-fe8c-4a2f-940b-aa0390a9109b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:42.966806 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4b6b-fe8c-4a2f-940b-aa0390a9109b service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:42.967092 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4b6b-fe8c-4a2f-940b-aa0390a9109b service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:42.967370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4b6b-fe8c-4a2f-940b-aa0390a9109b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:42.977425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f4b6b-fe8c-4a2f-940b-aa0390a9109b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:42.979078 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f4b6b-fe8c-4a2f-940b-aa0390a9109b service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:42.991085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 514/1023] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:13:45.405011 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df680-f327-451e-a3fc-eef23aca787d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:45.405962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df680-f327-451e-a3fc-eef23aca787d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:45.405962 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df680-f327-451e-a3fc-eef23aca787d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:45.407214 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 510/1024] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:45.412602 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefec55-1fb2-4f95-baa9-35b424d552ce None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:45.413094 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefec55-1fb2-4f95-baa9-35b424d552ce None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:45.413272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefec55-1fb2-4f95-baa9-35b424d552ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:45.435571 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ccefec55-1fb2-4f95-baa9-35b424d552ce None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:45.438202 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ccefec55-1fb2-4f95-baa9-35b424d552ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:45.448247 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 515/1025] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:13:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:45.495390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df680-f327-451e-a3fc-eef23aca787d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:13:45.510021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df680-f327-451e-a3fc-eef23aca787d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:13:45.519461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73a53a-942e-4900-af9d-fc409c755300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:13:45.520137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73a53a-942e-4900-af9d-fc409c755300 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:45.520427 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73a53a-942e-4900-af9d-fc409c755300 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:45.520704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73a53a-942e-4900-af9d-fc409c755300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:45.529831 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73a53a-942e-4900-af9d-fc409c755300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:13:45.531734 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73a53a-942e-4900-af9d-fc409c755300 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:13:45.542207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 511/1026] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:13:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:13:55.430633 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=55 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:55.537678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=7 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:58.307768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ef0e-2cfe-4f6d-8d73-fc5d6a7c5926 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:58.308510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ef0e-2cfe-4f6d-8d73-fc5d6a7c5926 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:58.308510 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ef0e-2cfe-4f6d-8d73-fc5d6a7c5926 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:58.309759 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 516/1027] 10.222.0.48 () {54 vars in 918 bytes} [Mon Jul 25 23:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:58.314707 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa038-93ce-4c96-94f1-f05da67389e4 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:58.315216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa038-93ce-4c96-94f1-f05da67389e4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:58.315851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa038-93ce-4c96-94f1-f05da67389e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:58.335701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-37caa038-93ce-4c96-94f1-f05da67389e4 None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:58.336879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-37caa038-93ce-4c96-94f1-f05da67389e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:58.345137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 512/1028] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jul 25 23:13:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:13:58.359789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640ebc5-80a2-4703-98e7-dc3c4425f342 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:58.360083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640ebc5-80a2-4703-98e7-dc3c4425f342 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:58.360368 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640ebc5-80a2-4703-98e7-dc3c4425f342 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:58.361714 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 517/1029] 10.222.0.48 () {54 vars in 918 bytes} [Mon Jul 25 23:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:13:58.367258 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b942058-c99f-4f2e-8edd-711415b482b0 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:13:58.367544 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b942058-c99f-4f2e-8edd-711415b482b0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:13:58.367821 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b942058-c99f-4f2e-8edd-711415b482b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:13:58.386952 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-3b942058-c99f-4f2e-8edd-711415b482b0 None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:13:58.388143 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3b942058-c99f-4f2e-8edd-711415b482b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:13:58.396481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 513/1030] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jul 25 23:13:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:01.156926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3563d1-aa71-448c-831d-292605dd0ede None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:01.157447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3563d1-aa71-448c-831d-292605dd0ede None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:01.157544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3563d1-aa71-448c-831d-292605dd0ede None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:01.158940 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 518/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:01.165510 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547436df-5cde-45ad-b6da-fae20fda1e79 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:01.165938 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547436df-5cde-45ad-b6da-fae20fda1e79 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:01.166084 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547436df-5cde-45ad-b6da-fae20fda1e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:01.185663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-547436df-5cde-45ad-b6da-fae20fda1e79 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:01.186888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-547436df-5cde-45ad-b6da-fae20fda1e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:01.195221 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 514/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:14:01.239489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3563d1-aa71-448c-831d-292605dd0ede None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:01.252467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3563d1-aa71-448c-831d-292605dd0ede None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:01.258325 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3b94-9414-40da-90dd-cedae53c6760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:01.260761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3b94-9414-40da-90dd-cedae53c6760 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:01.260761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3b94-9414-40da-90dd-cedae53c6760 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:01.260761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3b94-9414-40da-90dd-cedae53c6760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:01.267908 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3b94-9414-40da-90dd-cedae53c6760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:01.270639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3b94-9414-40da-90dd-cedae53c6760 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:01.280259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 519/1033] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:02.256664 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e9f6-3377-4977-8480-d6aad3169515 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:02.257285 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e9f6-3377-4977-8480-d6aad3169515 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:02.257285 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e9f6-3377-4977-8480-d6aad3169515 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:02.258575 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 515/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:02.263373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34dd1-ee3a-4760-9c60-25ddfe5e93d4 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:02.263810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34dd1-ee3a-4760-9c60-25ddfe5e93d4 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:02.263906 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34dd1-ee3a-4760-9c60-25ddfe5e93d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:02.285240 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-2fd34dd1-ee3a-4760-9c60-25ddfe5e93d4 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:02.286464 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-2fd34dd1-ee3a-4760-9c60-25ddfe5e93d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:02.294011 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 520/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:02.486233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e9f6-3377-4977-8480-d6aad3169515 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:02.499701 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e9f6-3377-4977-8480-d6aad3169515 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:02.505054 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2c8de-efce-4f18-960e-64e96cc6172f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:02.505649 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c8de-efce-4f18-960e-64e96cc6172f service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:02.505924 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c8de-efce-4f18-960e-64e96cc6172f service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:02.506194 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c8de-efce-4f18-960e-64e96cc6172f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:02.514106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c8de-efce-4f18-960e-64e96cc6172f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:02.515679 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c8de-efce-4f18-960e-64e96cc6172f service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:02.525581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 516/1036] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:03.427921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1469-99bc-4492-95f5-763c0bad6897 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:03.428460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1469-99bc-4492-95f5-763c0bad6897 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:03.428460 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1469-99bc-4492-95f5-763c0bad6897 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:03.429727 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 521/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:03.434794 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a3cf-acea-4bab-90fa-ccf6e263c56f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:03.435193 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a3cf-acea-4bab-90fa-ccf6e263c56f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:03.435347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a3cf-acea-4bab-90fa-ccf6e263c56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:03.454504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9617a3cf-acea-4bab-90fa-ccf6e263c56f None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:03.455755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9617a3cf-acea-4bab-90fa-ccf6e263c56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:03.463419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 517/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:03.619754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1469-99bc-4492-95f5-763c0bad6897 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:03.633025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1469-99bc-4492-95f5-763c0bad6897 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:03.637857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f6e3-3280-4ebe-9929-d5cfcf617f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:03.638494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f6e3-3280-4ebe-9929-d5cfcf617f9c service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:03.638771 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f6e3-3280-4ebe-9929-d5cfcf617f9c service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:03.639041 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f6e3-3280-4ebe-9929-d5cfcf617f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:03.647682 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f6e3-3280-4ebe-9929-d5cfcf617f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:03.649291 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f6e3-3280-4ebe-9929-d5cfcf617f9c service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:03.659477 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 522/1039] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:04.539077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf5a7-6a66-4ea6-b541-019ac1c6a275 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:04.539669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf5a7-6a66-4ea6-b541-019ac1c6a275 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:04.539669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf5a7-6a66-4ea6-b541-019ac1c6a275 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:04.540970 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 518/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:04.545824 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f8f3-5c8a-4313-a2aa-107d0e03cc83 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:04.546263 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f8f3-5c8a-4313-a2aa-107d0e03cc83 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:04.546447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f8f3-5c8a-4313-a2aa-107d0e03cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:04.566486 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-d986f8f3-5c8a-4313-a2aa-107d0e03cc83 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:04.567678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-d986f8f3-5c8a-4313-a2aa-107d0e03cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:04.575407 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 523/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:04.731000 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbf5a7-6a66-4ea6-b541-019ac1c6a275 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:04.744395 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbf5a7-6a66-4ea6-b541-019ac1c6a275 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:04.749297 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbd272-427a-4e40-bd39-c1cdb430f8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:04.749897 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd272-427a-4e40-bd39-c1cdb430f8e3 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:04.750179 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd272-427a-4e40-bd39-c1cdb430f8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:04.750485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbd272-427a-4e40-bd39-c1cdb430f8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:04.758834 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbd272-427a-4e40-bd39-c1cdb430f8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:04.760399 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbd272-427a-4e40-bd39-c1cdb430f8e3 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:04.770166 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 519/1042] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:05.634868 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506ba7-6bdf-4786-9d9b-dabaa84bf276 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:05.635386 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506ba7-6bdf-4786-9d9b-dabaa84bf276 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:05.635492 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb506ba7-6bdf-4786-9d9b-dabaa84bf276 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:05.636748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 524/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:05.641758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade588a-f78d-45dc-9b6e-37d51c6d6ebe None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:05.642182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade588a-f78d-45dc-9b6e-37d51c6d6ebe None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:05.642351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade588a-f78d-45dc-9b6e-37d51c6d6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:05.662371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-eade588a-f78d-45dc-9b6e-37d51c6d6ebe None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:05.663567 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-eade588a-f78d-45dc-9b6e-37d51c6d6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:05.671402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 520/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:05.826949 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506ba7-6bdf-4786-9d9b-dabaa84bf276 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:05.840283 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb506ba7-6bdf-4786-9d9b-dabaa84bf276 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:05.845147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772d1bd-d735-49a2-970b-0b1f30b3b9a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:05.845713 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d1bd-d735-49a2-970b-0b1f30b3b9a5 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:05.845994 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d1bd-d735-49a2-970b-0b1f30b3b9a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:05.846805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d1bd-d735-49a2-970b-0b1f30b3b9a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:05.854778 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772d1bd-d735-49a2-970b-0b1f30b3b9a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:05.856330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772d1bd-d735-49a2-970b-0b1f30b3b9a5 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:05.866667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 525/1045] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:06.734529 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ee38-c12d-4431-8c88-dfd0404ce5ee None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.735059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ee38-c12d-4431-8c88-dfd0404ce5ee None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.735059 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ee38-c12d-4431-8c88-dfd0404ce5ee None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.736459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 521/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:06.741896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d32d1-ffc0-4f77-bfe0-bbfb5f1ae266 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.742308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d32d1-ffc0-4f77-bfe0-bbfb5f1ae266 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.742474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d32d1-ffc0-4f77-bfe0-bbfb5f1ae266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.761961 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-a54d32d1-ffc0-4f77-bfe0-bbfb5f1ae266 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:06.763170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-a54d32d1-ffc0-4f77-bfe0-bbfb5f1ae266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:06.771236 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 526/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:06.925941 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ee38-c12d-4431-8c88-dfd0404ce5ee None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:06.939087 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ee38-c12d-4431-8c88-dfd0404ce5ee None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:06.944951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443095a1-207f-4ae2-812b-83d319bf6765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:06.945550 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443095a1-207f-4ae2-812b-83d319bf6765 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:06.945824 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443095a1-207f-4ae2-812b-83d319bf6765 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:06.946092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443095a1-207f-4ae2-812b-83d319bf6765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:06.953961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443095a1-207f-4ae2-812b-83d319bf6765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:06.955552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443095a1-207f-4ae2-812b-83d319bf6765 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:06.964851 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 522/1048] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:07.821166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88f0a5-90eb-47d1-8266-de4020221fa1 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.821705 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88f0a5-90eb-47d1-8266-de4020221fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.821705 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88f0a5-90eb-47d1-8266-de4020221fa1 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.823083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 527/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:07.827950 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae04c4e-5b8a-4a48-918f-f4293b060e8c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:07.828355 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae04c4e-5b8a-4a48-918f-f4293b060e8c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:07.828499 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae04c4e-5b8a-4a48-918f-f4293b060e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:07.848140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4ae04c4e-5b8a-4a48-918f-f4293b060e8c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:07.849245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4ae04c4e-5b8a-4a48-918f-f4293b060e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:07.856925 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 523/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:08.014178 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88f0a5-90eb-47d1-8266-de4020221fa1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:08.027643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88f0a5-90eb-47d1-8266-de4020221fa1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:08.032688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf17d3-d136-4f80-8fd0-24c1faf4270b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:08.033288 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf17d3-d136-4f80-8fd0-24c1faf4270b service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:08.033580 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf17d3-d136-4f80-8fd0-24c1faf4270b service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:08.034494 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf17d3-d136-4f80-8fd0-24c1faf4270b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:08.042429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf17d3-d136-4f80-8fd0-24c1faf4270b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:08.043984 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf17d3-d136-4f80-8fd0-24c1faf4270b service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:08.053680 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 528/1051] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:08.937012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5f0c-8697-4a53-9110-7db46a6c4fd7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:08.937540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5f0c-8697-4a53-9110-7db46a6c4fd7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:08.937540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5f0c-8697-4a53-9110-7db46a6c4fd7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:08.938969 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 524/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:08.944517 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615ff8-097c-4d8a-b6a1-dade7f678b00 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:08.944927 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615ff8-097c-4d8a-b6a1-dade7f678b00 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:08.945086 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615ff8-097c-4d8a-b6a1-dade7f678b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:08.964468 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-f0615ff8-097c-4d8a-b6a1-dade7f678b00 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:08.965662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f0615ff8-097c-4d8a-b6a1-dade7f678b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:08.973365 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 529/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:09.130184 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5f0c-8697-4a53-9110-7db46a6c4fd7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:09.143757 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5f0c-8697-4a53-9110-7db46a6c4fd7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:09.148619 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4c210-b616-405b-ab7d-2393078f6738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:09.149215 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c210-b616-405b-ab7d-2393078f6738 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:09.149493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c210-b616-405b-ab7d-2393078f6738 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:09.149763 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c210-b616-405b-ab7d-2393078f6738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:09.157937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4c210-b616-405b-ab7d-2393078f6738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:09.159723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4c210-b616-405b-ab7d-2393078f6738 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:09.168968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 525/1054] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:10.039582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7ebda-d879-43f1-89cc-0fc2140eb098 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:10.040151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7ebda-d879-43f1-89cc-0fc2140eb098 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:10.040151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7ebda-d879-43f1-89cc-0fc2140eb098 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:10.041447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 530/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:10.046347 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d6bf-50c4-474f-8492-bc25acd52783 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:10.046777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d6bf-50c4-474f-8492-bc25acd52783 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:10.046912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d6bf-50c4-474f-8492-bc25acd52783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:10.066730 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7343d6bf-50c4-474f-8492-bc25acd52783 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:10.067920 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7343d6bf-50c4-474f-8492-bc25acd52783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:10.075616 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 526/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:14:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:10.232695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7ebda-d879-43f1-89cc-0fc2140eb098 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:10.246010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7ebda-d879-43f1-89cc-0fc2140eb098 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:10.251000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526a1a-8151-4320-8e4f-6cde1d32dc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:10.251606 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526a1a-8151-4320-8e4f-6cde1d32dc2b service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:10.251887 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526a1a-8151-4320-8e4f-6cde1d32dc2b service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:10.252164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526a1a-8151-4320-8e4f-6cde1d32dc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:10.261166 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526a1a-8151-4320-8e4f-6cde1d32dc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:10.262784 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526a1a-8151-4320-8e4f-6cde1d32dc2b service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:10.272839 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 531/1057] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:12.388879 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9084-8a1f-41ce-8bd1-1cc214fc2fdd None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:12.389421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9084-8a1f-41ce-8bd1-1cc214fc2fdd None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:12.389421 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e9084-8a1f-41ce-8bd1-1cc214fc2fdd None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:12.390825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 527/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:12.396790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515f340-cfd3-41f2-b56d-b2e66dc41126 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:12.397216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515f340-cfd3-41f2-b56d-b2e66dc41126 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:12.397342 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515f340-cfd3-41f2-b56d-b2e66dc41126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:12.416564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-1515f340-cfd3-41f2-b56d-b2e66dc41126 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:12.417744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-1515f340-cfd3-41f2-b56d-b2e66dc41126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:12.425478 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 532/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:12.465697 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9084-8a1f-41ce-8bd1-1cc214fc2fdd None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:12.476408 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e9084-8a1f-41ce-8bd1-1cc214fc2fdd None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:12.479891 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac05cef-70f9-49dc-9c09-da88fd89c361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:12.480498 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac05cef-70f9-49dc-9c09-da88fd89c361 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:12.480780 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac05cef-70f9-49dc-9c09-da88fd89c361 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:12.481057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac05cef-70f9-49dc-9c09-da88fd89c361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:12.489976 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac05cef-70f9-49dc-9c09-da88fd89c361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:12.491476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac05cef-70f9-49dc-9c09-da88fd89c361 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:12.500683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 528/1060] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:14.915021 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f3a8-f1ff-4756-b2f2-bdfc48ad6589 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:14.915550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f3a8-f1ff-4756-b2f2-bdfc48ad6589 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:14.915550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f3a8-f1ff-4756-b2f2-bdfc48ad6589 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:14.916824 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 533/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:14.922108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b104e-e340-44ac-a0ae-d0f621680909 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:14.922614 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b104e-e340-44ac-a0ae-d0f621680909 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:14.922829 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b104e-e340-44ac-a0ae-d0f621680909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:14.942848 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5e2b104e-e340-44ac-a0ae-d0f621680909 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:14.944053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5e2b104e-e340-44ac-a0ae-d0f621680909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:14.952191 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 529/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:14.998873 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f3a8-f1ff-4756-b2f2-bdfc48ad6589 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:15.010298 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f3a8-f1ff-4756-b2f2-bdfc48ad6589 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:15.013758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdfaa7-3369-4701-bba0-8c245ae8124b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:15.014394 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdfaa7-3369-4701-bba0-8c245ae8124b service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:15.014673 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdfaa7-3369-4701-bba0-8c245ae8124b service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:15.014946 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdfaa7-3369-4701-bba0-8c245ae8124b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:15.023822 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdfaa7-3369-4701-bba0-8c245ae8124b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:15.025238 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdfaa7-3369-4701-bba0-8c245ae8124b service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:15.034884 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 534/1063] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:17.732579 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd829a0e-dc5e-4dea-8cc2-54594e72a01c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:17.733145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd829a0e-dc5e-4dea-8cc2-54594e72a01c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:17.733145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd829a0e-dc5e-4dea-8cc2-54594e72a01c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:17.734530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 530/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:17.740465 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cf457-6371-4f91-8c67-609915962fd8 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:17.740876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cf457-6371-4f91-8c67-609915962fd8 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:17.741028 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cf457-6371-4f91-8c67-609915962fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:17.759986 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-6a8cf457-6371-4f91-8c67-609915962fd8 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:17.761179 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-6a8cf457-6371-4f91-8c67-609915962fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:17.768977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 535/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:17.809716 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd829a0e-dc5e-4dea-8cc2-54594e72a01c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:17.820393 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd829a0e-dc5e-4dea-8cc2-54594e72a01c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:17.823852 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c21b4-746b-4b72-86c7-608927db3934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:17.824449 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c21b4-746b-4b72-86c7-608927db3934 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:17.824726 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c21b4-746b-4b72-86c7-608927db3934 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:17.824998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c21b4-746b-4b72-86c7-608927db3934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:17.833835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c21b4-746b-4b72-86c7-608927db3934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:17.835287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c21b4-746b-4b72-86c7-608927db3934 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:17.844743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 531/1066] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:20.194416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc48d-7172-416e-8d15-b350cacecac7 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:20.194934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc48d-7172-416e-8d15-b350cacecac7 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:20.194934 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc48d-7172-416e-8d15-b350cacecac7 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:20.196338 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 536/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:14:20.201827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67132fed-1afe-4ead-8c93-56325fe2f54b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:20.202307 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67132fed-1afe-4ead-8c93-56325fe2f54b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:20.202468 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67132fed-1afe-4ead-8c93-56325fe2f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:20.223428 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-67132fed-1afe-4ead-8c93-56325fe2f54b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:20.224540 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-67132fed-1afe-4ead-8c93-56325fe2f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:20.232114 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 532/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:20.273918 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc48d-7172-416e-8d15-b350cacecac7 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:20.286043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc48d-7172-416e-8d15-b350cacecac7 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:20.289871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c3412-06be-4e39-a4ed-87d3e7a3a57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:20.290574 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c3412-06be-4e39-a4ed-87d3e7a3a57c service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:20.290852 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c3412-06be-4e39-a4ed-87d3e7a3a57c service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:20.296614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c3412-06be-4e39-a4ed-87d3e7a3a57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:20.301011 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c3412-06be-4e39-a4ed-87d3e7a3a57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:20.302624 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c3412-06be-4e39-a4ed-87d3e7a3a57c service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:20.312217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 537/1069] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:22.609123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943781-784f-46df-88f9-c4e957b78024 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:22.609617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943781-784f-46df-88f9-c4e957b78024 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:22.609713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943781-784f-46df-88f9-c4e957b78024 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:22.611057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 533/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:22.616912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e08da5-64c5-4643-8198-b86498ce8b5a None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:22.617307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e08da5-64c5-4643-8198-b86498ce8b5a None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:22.617477 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e08da5-64c5-4643-8198-b86498ce8b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:22.636796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-92e08da5-64c5-4643-8198-b86498ce8b5a None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:22.637988 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-92e08da5-64c5-4643-8198-b86498ce8b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:22.645613 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 538/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:22.684801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943781-784f-46df-88f9-c4e957b78024 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:22.696122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943781-784f-46df-88f9-c4e957b78024 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:22.699630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa3993-1948-4e0a-b000-7a5445cbfedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:22.700233 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa3993-1948-4e0a-b000-7a5445cbfedd service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:22.700512 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa3993-1948-4e0a-b000-7a5445cbfedd service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:22.700786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa3993-1948-4e0a-b000-7a5445cbfedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:22.709544 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa3993-1948-4e0a-b000-7a5445cbfedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:22.711009 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa3993-1948-4e0a-b000-7a5445cbfedd service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:22.720226 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 534/1072] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:25.001550 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bccc-e37f-4bd8-8dd3-ffe3e1ec2705 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:25.002102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bccc-e37f-4bd8-8dd3-ffe3e1ec2705 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:25.002102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bccc-e37f-4bd8-8dd3-ffe3e1ec2705 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:25.003558 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 539/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:25.008917 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d250e7-dc68-4783-8578-fdd009d9a107 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:25.009320 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d250e7-dc68-4783-8578-fdd009d9a107 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:25.009474 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d250e7-dc68-4783-8578-fdd009d9a107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:25.028767 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-21d250e7-dc68-4783-8578-fdd009d9a107 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:25.029948 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-21d250e7-dc68-4783-8578-fdd009d9a107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:25.038731 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 535/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:25.077536 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bccc-e37f-4bd8-8dd3-ffe3e1ec2705 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:25.088717 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bccc-e37f-4bd8-8dd3-ffe3e1ec2705 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:25.092183 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295fec6-9fd3-4912-9814-c9cd417019df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:25.092785 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295fec6-9fd3-4912-9814-c9cd417019df service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:25.093064 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295fec6-9fd3-4912-9814-c9cd417019df service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:25.093339 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295fec6-9fd3-4912-9814-c9cd417019df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:25.102514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295fec6-9fd3-4912-9814-c9cd417019df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:25.103735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295fec6-9fd3-4912-9814-c9cd417019df service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:25.113072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 540/1075] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:27.406799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a2af4-7e5d-49cc-8ee6-60195b593473 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:27.407324 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a2af4-7e5d-49cc-8ee6-60195b593473 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:27.407324 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a2af4-7e5d-49cc-8ee6-60195b593473 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:27.408850 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 536/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:27.414259 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ba75e-39c4-46ba-ac24-a33a16c84a32 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:27.414738 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ba75e-39c4-46ba-ac24-a33a16c84a32 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:27.414835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ba75e-39c4-46ba-ac24-a33a16c84a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:27.422153 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=70 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:27.434005 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-674ba75e-39c4-46ba-ac24-a33a16c84a32 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:27.435219 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-674ba75e-39c4-46ba-ac24-a33a16c84a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:27.443835 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 541/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:27.482804 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a2af4-7e5d-49cc-8ee6-60195b593473 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:27.488401 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=73 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:27.494057 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a2af4-7e5d-49cc-8ee6-60195b593473 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:27.497660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38536c-6ff3-4e99-866e-fc3f214a9dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:27.502777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38536c-6ff3-4e99-866e-fc3f214a9dda service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:27.502777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38536c-6ff3-4e99-866e-fc3f214a9dda service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:27.502777 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38536c-6ff3-4e99-866e-fc3f214a9dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:27.508995 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38536c-6ff3-4e99-866e-fc3f214a9dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:27.510489 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38536c-6ff3-4e99-866e-fc3f214a9dda service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:27.520668 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 537/1078] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:29.795988 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858547a-6452-4e5d-8392-cbcd2d4d1ba6 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:29.796584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858547a-6452-4e5d-8392-cbcd2d4d1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:29.796584 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858547a-6452-4e5d-8392-cbcd2d4d1ba6 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:29.797871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 542/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:29.803746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22555-0464-48f2-977e-076e271c9604 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:29.804161 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22555-0464-48f2-977e-076e271c9604 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:29.804346 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22555-0464-48f2-977e-076e271c9604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:29.823398 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fff22555-0464-48f2-977e-076e271c9604 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:29.824624 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fff22555-0464-48f2-977e-076e271c9604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:29.832438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 538/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:29.871000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858547a-6452-4e5d-8392-cbcd2d4d1ba6 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:29.881977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858547a-6452-4e5d-8392-cbcd2d4d1ba6 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:29.885456 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2166f-f72d-4a77-98aa-5cd208ed734f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:29.886051 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2166f-f72d-4a77-98aa-5cd208ed734f service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:29.886356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2166f-f72d-4a77-98aa-5cd208ed734f service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:29.886627 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2166f-f72d-4a77-98aa-5cd208ed734f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:29.895989 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2166f-f72d-4a77-98aa-5cd208ed734f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:29.897388 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2166f-f72d-4a77-98aa-5cd208ed734f service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:29.907484 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 543/1081] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:32.148053 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5d70b-d147-44be-9e83-d713fc6a5a52 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:32.148622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5d70b-d147-44be-9e83-d713fc6a5a52 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:32.148622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5d70b-d147-44be-9e83-d713fc6a5a52 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:32.149953 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 539/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:32.155111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2b74-31b5-4ea2-9b61-fd6284cd4f4b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:32.155560 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2b74-31b5-4ea2-9b61-fd6284cd4f4b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:32.155671 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2b74-31b5-4ea2-9b61-fd6284cd4f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:32.176330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e0bd2b74-31b5-4ea2-9b61-fd6284cd4f4b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:32.177549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e0bd2b74-31b5-4ea2-9b61-fd6284cd4f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:32.185341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 544/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:32.223966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5d70b-d147-44be-9e83-d713fc6a5a52 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:32.234797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5d70b-d147-44be-9e83-d713fc6a5a52 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:32.239085 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab319bf7-f9ea-477f-ab05-fa18f303c6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:32.240000 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab319bf7-f9ea-477f-ab05-fa18f303c6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:32.240303 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab319bf7-f9ea-477f-ab05-fa18f303c6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:32.240573 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab319bf7-f9ea-477f-ab05-fa18f303c6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:32.249333 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab319bf7-f9ea-477f-ab05-fa18f303c6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:32.250825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab319bf7-f9ea-477f-ab05-fa18f303c6a3 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:32.261092 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 540/1084] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:34.511208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e1b8-5ab7-44f9-be7c-6027951ed8b4 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:34.511769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e1b8-5ab7-44f9-be7c-6027951ed8b4 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:34.511769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17e1b8-5ab7-44f9-be7c-6027951ed8b4 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:34.513102 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 545/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:34.518429 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed11d-1a54-42af-9f04-ebca342195fe None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:34.518828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed11d-1a54-42af-9f04-ebca342195fe None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:34.518988 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed11d-1a54-42af-9f04-ebca342195fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:34.538071 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-994ed11d-1a54-42af-9f04-ebca342195fe None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:34.539281 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-994ed11d-1a54-42af-9f04-ebca342195fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:34.547028 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 541/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:14:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:34.585983 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e1b8-5ab7-44f9-be7c-6027951ed8b4 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:34.597176 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17e1b8-5ab7-44f9-be7c-6027951ed8b4 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:34.600662 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d77c66-f299-4313-af64-a393ab0c97d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:34.601297 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d77c66-f299-4313-af64-a393ab0c97d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:34.603072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d77c66-f299-4313-af64-a393ab0c97d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:34.603072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d77c66-f299-4313-af64-a393ab0c97d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:34.610820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d77c66-f299-4313-af64-a393ab0c97d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:34.612868 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d77c66-f299-4313-af64-a393ab0c97d8 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:34.622143 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 546/1087] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:14:44.533045 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=17 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:44.617959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=17 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:58.444035 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60488d-86eb-4091-bad0-a4f356d50d8e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:58.444604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60488d-86eb-4091-bad0-a4f356d50d8e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:58.444604 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60488d-86eb-4091-bad0-a4f356d50d8e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:58.445944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 542/1088] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:58.451239 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242431-63ae-489e-9c45-314ee8e13bcf None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:58.451683 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242431-63ae-489e-9c45-314ee8e13bcf None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:58.451789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242431-63ae-489e-9c45-314ee8e13bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:58.471228 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-02242431-63ae-489e-9c45-314ee8e13bcf None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:58.472428 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-02242431-63ae-489e-9c45-314ee8e13bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:58.480105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 547/1089] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:14:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:58.529840 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a128-1365-4e40-adfe-c574c7214b74 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:58.530129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a128-1365-4e40-adfe-c574c7214b74 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:58.530438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a128-1365-4e40-adfe-c574c7214b74 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:58.532037 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 543/1090] 10.222.0.48 () {54 vars in 966 bytes} [Mon Jul 25 23:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:14:58.537734 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c8bf0-9b1e-4abf-a6d0-53f55548e226 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:58.538025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c8bf0-9b1e-4abf-a6d0-53f55548e226 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:58.538360 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c8bf0-9b1e-4abf-a6d0-53f55548e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:58.558366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9b5c8bf0-9b1e-4abf-a6d0-53f55548e226 None None] MFA Rules not processed for user `b422d3c782ae4b86a3af62a83b2a6489`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:14:58.559618 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9b5c8bf0-9b1e-4abf-a6d0-53f55548e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:14:58.566637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 548/1091] 10.222.0.48 () {58 vars in 1063 bytes} [Mon Jul 25 23:14:58 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:14:58.574003 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a128-1365-4e40-adfe-c574c7214b74 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:14:58.585132 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a128-1365-4e40-adfe-c574c7214b74 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:14:58.588609 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034108f-f421-4059-9a97-f481781f2e9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b422d3c782ae4b86a3af62a83b2a6489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:14:58.589218 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034108f-f421-4059-9a97-f481781f2e9d service glance] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:14:58.589492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034108f-f421-4059-9a97-f481781f2e9d service glance] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:14:58.589758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034108f-f421-4059-9a97-f481781f2e9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:14:58.599448 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034108f-f421-4059-9a97-f481781f2e9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:14:58.600855 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034108f-f421-4059-9a97-f481781f2e9d service glance] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:14:58.609889 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 544/1092] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:14:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:00.991698 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7642f-2774-4b1a-b5cd-536e39047e2b None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:00.992295 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7642f-2774-4b1a-b5cd-536e39047e2b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:00.992295 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7642f-2774-4b1a-b5cd-536e39047e2b None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:00.993630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 549/1093] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:15:00.998798 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d2ee0-8a40-4c89-8203-8465306ba2bc None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:00.999208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d2ee0-8a40-4c89-8203-8465306ba2bc None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:00.999348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d2ee0-8a40-4c89-8203-8465306ba2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:01.019492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-785d2ee0-8a40-4c89-8203-8465306ba2bc None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:01.020685 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-785d2ee0-8a40-4c89-8203-8465306ba2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:01.028727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 545/1094] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:15:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:15:01.053751 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7642f-2774-4b1a-b5cd-536e39047e2b None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:01.066735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7642f-2774-4b1a-b5cd-536e39047e2b None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:01.071136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:01.071735 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:01.072016 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:01.072290 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:01.073038 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:01.074813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:15:01.074813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:15:01.074813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:15:01.075938 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f997d98-26f5-4710-96ca-7902736db16a admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:01.094376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 550/1095] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 23:15:01 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:15:03.344842 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778c72-8908-4ef5-938e-026d30e7ce7a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:03.345915 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778c72-8908-4ef5-938e-026d30e7ce7a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:03.345915 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778c72-8908-4ef5-938e-026d30e7ce7a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:03.347629 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 546/1096] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:15:03.352719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79c04-70b8-4070-8233-659eb3fee150 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:03.353127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79c04-70b8-4070-8233-659eb3fee150 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:03.353277 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79c04-70b8-4070-8233-659eb3fee150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:03.372547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-f5e79c04-70b8-4070-8233-659eb3fee150 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:03.373739 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f5e79c04-70b8-4070-8233-659eb3fee150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:03.381489 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 551/1097] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:15:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:15:03.425365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778c72-8908-4ef5-938e-026d30e7ce7a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:03.438547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778c72-8908-4ef5-938e-026d30e7ce7a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:03.443929 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1535d-5ab4-45eb-98e0-e2e48dd4e895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:03.446423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1535d-5ab4-45eb-98e0-e2e48dd4e895 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:03.446423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1535d-5ab4-45eb-98e0-e2e48dd4e895 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:03.446423 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1535d-5ab4-45eb-98e0-e2e48dd4e895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:03.453058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1535d-5ab4-45eb-98e0-e2e48dd4e895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:03.454662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1535d-5ab4-45eb-98e0-e2e48dd4e895 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:03.464507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 547/1098] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:15:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:15:05.886038 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b689fd-a3f0-4b7c-9f08-02f8859008c1 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:05.886612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b689fd-a3f0-4b7c-9f08-02f8859008c1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:05.886612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b689fd-a3f0-4b7c-9f08-02f8859008c1 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:05.887872 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 552/1099] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:15:05.893488 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491fe8-045f-43ac-ab48-2ebb39d06754 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:05.893935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491fe8-045f-43ac-ab48-2ebb39d06754 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:05.894034 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491fe8-045f-43ac-ab48-2ebb39d06754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:05.914660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-13491fe8-045f-43ac-ab48-2ebb39d06754 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:05.915853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-13491fe8-045f-43ac-ab48-2ebb39d06754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:05.924098 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 548/1100] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:15:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:15:05.961732 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b689fd-a3f0-4b7c-9f08-02f8859008c1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:05.973180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b689fd-a3f0-4b7c-9f08-02f8859008c1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:05.976626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e5cdf-eced-44f0-8b4c-9e94ce6a2321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:05.977226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e5cdf-eced-44f0-8b4c-9e94ce6a2321 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:05.977505 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e5cdf-eced-44f0-8b4c-9e94ce6a2321 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:05.977777 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e5cdf-eced-44f0-8b4c-9e94ce6a2321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:05.986695 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e5cdf-eced-44f0-8b4c-9e94ce6a2321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:05.988105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e5cdf-eced-44f0-8b4c-9e94ce6a2321 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:05.997276 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 553/1101] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:15:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:08.294699 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968ae2-4729-462d-9b00-8dc0d9824ecc None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:08.295329 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968ae2-4729-462d-9b00-8dc0d9824ecc None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:08.295610 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968ae2-4729-462d-9b00-8dc0d9824ecc None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:08.297139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 549/1102] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:15:08.303260 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259432c-651e-4d68-93ea-99436bc55d02 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:08.303716 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259432c-651e-4d68-93ea-99436bc55d02 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:08.303822 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259432c-651e-4d68-93ea-99436bc55d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:08.324399 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-d259432c-651e-4d68-93ea-99436bc55d02 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:08.325598 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-d259432c-651e-4d68-93ea-99436bc55d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:08.333516 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 554/1103] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:15:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:15:08.372131 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968ae2-4729-462d-9b00-8dc0d9824ecc None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:08.383779 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968ae2-4729-462d-9b00-8dc0d9824ecc None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:08.387236 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cd881-867c-429d-b474-7c787ba56cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:08.387836 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cd881-867c-429d-b474-7c787ba56cfb service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:08.388117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cd881-867c-429d-b474-7c787ba56cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:08.388389 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cd881-867c-429d-b474-7c787ba56cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:08.397232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cd881-867c-429d-b474-7c787ba56cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:08.398713 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cd881-867c-429d-b474-7c787ba56cfb service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:08.408468 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 550/1104] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:15:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:10.713617 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10ddc9-8386-4266-b568-c4e5357d47db None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:10.723647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10ddc9-8386-4266-b568-c4e5357d47db None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:10.723647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10ddc9-8386-4266-b568-c4e5357d47db None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:10.723647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 555/1105] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:15:10.723937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0b14-b11c-4b83-b2be-5e880b5907bf None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:10.723937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0b14-b11c-4b83-b2be-5e880b5907bf None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:10.723937 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0b14-b11c-4b83-b2be-5e880b5907bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:10.743231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-cb3b0b14-b11c-4b83-b2be-5e880b5907bf None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:10.744549 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-cb3b0b14-b11c-4b83-b2be-5e880b5907bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:10.753657 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 551/1106] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:15:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:15:10.795295 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10ddc9-8386-4266-b568-c4e5357d47db None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:10.807384 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10ddc9-8386-4266-b568-c4e5357d47db None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:10.810928 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6b08f-2aef-453d-9d45-d9d24634356b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:10.811534 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6b08f-2aef-453d-9d45-d9d24634356b service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:10.811817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6b08f-2aef-453d-9d45-d9d24634356b service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:10.812093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6b08f-2aef-453d-9d45-d9d24634356b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:10.821876 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6b08f-2aef-453d-9d45-d9d24634356b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:10.823330 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6b08f-2aef-453d-9d45-d9d24634356b service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:10.832966 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 556/1107] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:15:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:13.548154 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1c104-52d4-4a96-b658-d73511288bd5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:13.549390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1c104-52d4-4a96-b658-d73511288bd5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:13.549680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1c104-52d4-4a96-b658-d73511288bd5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:13.551162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 552/1108] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 23:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:15:13.556422 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05809de-e285-4a61-a60b-72f812420e8d None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:13.556823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05809de-e285-4a61-a60b-72f812420e8d None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:13.556977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05809de-e285-4a61-a60b-72f812420e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:13.576817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-e05809de-e285-4a61-a60b-72f812420e8d None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:15:13.578230 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-e05809de-e285-4a61-a60b-72f812420e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:15:13.588851 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 557/1109] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 23:15:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:15:13.626212 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1c104-52d4-4a96-b658-d73511288bd5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:15:13.637754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1c104-52d4-4a96-b658-d73511288bd5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:15:13.641222 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39cbf-29cd-4209-a4d9-461870ad295c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:15:13.641854 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39cbf-29cd-4209-a4d9-461870ad295c service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:15:13.642185 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39cbf-29cd-4209-a4d9-461870ad295c service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:15:13.642529 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39cbf-29cd-4209-a4d9-461870ad295c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:15:13.651630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39cbf-29cd-4209-a4d9-461870ad295c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:15:13.655545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39cbf-29cd-4209-a4d9-461870ad295c service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:15:13.662888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 553/1110] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:15:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:15:23.571804 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=33 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:23.658878 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=33 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:54.688168 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:54.688761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:54.688761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:54.708658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:54.710416 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:54.718325 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 558/1111] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:16:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:54.726202 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:54.726729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:54.726824 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:54.746382 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:54.747582 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:54.755282 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 554/1112] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:16:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:54.760555 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:54.769948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219d042-2381-4580-8cdd-68a69bbb80c0 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:54.775222 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:54.775843 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:54.776126 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:54.776403 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:54.777096 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:16:54.777404 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:54.778448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:54.778448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:16:54.778448 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:16:54.779327 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:54.790950 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 559/1113] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 23:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:16:54.799013 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:54.808443 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9025b5-25dd-44cd-97b9-9682e076af59 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:54.812946 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:54.813566 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:54.813843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:54.814118 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:54.814803 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:54.816546 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:54.816546 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:16:54.816546 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:16:54.817735 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:54.921655 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 555/1114] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 23:16:54 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:54.926570 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:54.936937 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55e53-b9c2-4199-a75b-13dec0b2977c admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:54.994772 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:54.995315 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:54.995600 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:54.995872 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:54.996541 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:54.997546 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:54.997546 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:16:54.997546 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:16:54.998756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:55.134470 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 560/1115] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:16:54 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:16:55.138608 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:55.149031 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdcb2e-2199-4bd5-81f5-a06033fb9580 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:55.153523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:55.156001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.156001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.156001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.156001 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:55.156453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:55.156453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:16:55.156453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:16:55.157342 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:55.171552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 556/1116] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:55.180326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:55.190598 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b890-1a86-443a-9676-01a8103bd0ca admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:55.195612 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:55.196245 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.196525 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.196799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.197491 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:55.198537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:55.198537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:16:55.198537 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:16:55.199411 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81199286-42b5-42f8-9dae-f4cd4399ba22 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:55.213441 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 561/1117] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:16:55.217902 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:55.228513 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03778a8-92af-46ba-beec-e15714fbab70 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:55.233346 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:55.234013 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.234314 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.234599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] PATH_INFO: `/v3/projects/e8af8fe1a29049eb99cb33410d9d5904/users/fa6a50521b094da0a8ba7eee5ff4559b/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.249687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8af8fe1a29049eb99cb33410d9d5904, user_id=fa6a50521b094da0a8ba7eee5ff4559b, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:55.250683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:55.250683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:16:55.250683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:16:55.252599 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba5ca7-a2ba-41c3-9023-668c39735625 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:55.340524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 557/1118] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:16:55 2022] PUT /identity/v3/projects/e8af8fe1a29049eb99cb33410d9d5904/users/fa6a50521b094da0a8ba7eee5ff4559b/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:55.353899 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318967-abb2-4745-87b0-c1d15c652569 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.354185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318967-abb2-4745-87b0-c1d15c652569 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.354485 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318967-abb2-4745-87b0-c1d15c652569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.382161 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-f6318967-abb2-4745-87b0-c1d15c652569 None None] MFA Rules not processed for user `fa6a50521b094da0a8ba7eee5ff4559b`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:55.383409 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f6318967-abb2-4745-87b0-c1d15c652569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:55.447877 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 562/1119] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:16:55 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:55.461358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76457-169f-4629-958b-d739d6ea5c48 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.461650 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76457-169f-4629-958b-d739d6ea5c48 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.461949 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a76457-169f-4629-958b-d739d6ea5c48 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.463321 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 558/1120] 10.222.0.48 () {54 vars in 964 bytes} [Mon Jul 25 23:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:16:55.468060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5652c4-2b22-4855-9c9f-70fa76305821 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.468351 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5652c4-2b22-4855-9c9f-70fa76305821 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.468630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5652c4-2b22-4855-9c9f-70fa76305821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.488644 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-bf5652c4-2b22-4855-9c9f-70fa76305821 None None] MFA Rules not processed for user `240ff8f23838441aa25ca1cf766c7014`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:55.489828 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-bf5652c4-2b22-4855-9c9f-70fa76305821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:55.544159 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:55.551429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 563/1121] 10.222.0.48 () {58 vars in 1061 bytes} [Mon Jul 25 23:16:55 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:55.559232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76457-169f-4629-958b-d739d6ea5c48 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:55.572361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a76457-169f-4629-958b-d739d6ea5c48 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:55.575930 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240ff8f23838441aa25ca1cf766c7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:55.576530 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.576805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.577076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.586663 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:55.588082 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:55.597113 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 559/1122] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:55 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:55.636795 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b915ed-8215-460a-b3bb-8c721d2a7348 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.637085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b915ed-8215-460a-b3bb-8c721d2a7348 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.637392 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b915ed-8215-460a-b3bb-8c721d2a7348 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.638694 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 564/1123] 10.222.0.48 () {52 vars in 830 bytes} [Mon Jul 25 23:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:16:55.642112 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:55.704570 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e8ce-3ad2-4dd9-bd57-b68f0833d8c0 service cinder] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:55.709649 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:55.710461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:55.710740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:55.711012 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] PATH_INFO: `/v3/users/fa6a50521b094da0a8ba7eee5ff4559b` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:55.712189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6a50521b094da0a8ba7eee5ff4559b)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:55.713175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:55.713175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:16:55.713175 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:16:55.714439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:55.925127 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6a50521b094da0a8ba7eee5ff4559b'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:56.016292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6a50521b094da0a8ba7eee5ff4559b'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:56.017026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6a50521b094da0a8ba7eee5ff4559b'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:56.017630 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6a50521b094da0a8ba7eee5ff4559b'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:56.030804 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6a50521b094da0a8ba7eee5ff4559b'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:56.047231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:56.055469 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 560/1124] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 23:16:55 2022] DELETE /identity/v3/users/fa6a50521b094da0a8ba7eee5ff4559b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:16:56.060164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:56.060701 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:56.060824 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:56.080322 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:16:56.081523 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:56.139796 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 565/1125] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:16:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:16:56.149265 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:56.150694 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:56.347754 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0cf0-2797-48fc-ba5b-5c46232ea36d admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:56.351369 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8736dc-35e2-4c3f-af30-4e9877533dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:56.352040 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8736dc-35e2-4c3f-af30-4e9877533dbb service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:56.352322 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8736dc-35e2-4c3f-af30-4e9877533dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:56.352594 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8736dc-35e2-4c3f-af30-4e9877533dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:56.361554 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8736dc-35e2-4c3f-af30-4e9877533dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:56.363069 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8736dc-35e2-4c3f-af30-4e9877533dbb service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:56.373200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 561/1126] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:16:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:16:56.890643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:16:56.892116 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:16:56.907391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b89352-5b5c-4a63-8d5d-786b0defbe61 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:16:56.911265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:16:56.912583 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:16:56.913498 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:16:56.913780 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] PATH_INFO: `/v3/projects/e8af8fe1a29049eb99cb33410d9d5904` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:16:56.914975 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8af8fe1a29049eb99cb33410d9d5904)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:16:56.916000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:16:56.916000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:16:56.916000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:16:56.917178 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:16:57.038789 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8af8fe1a29049eb99cb33410d9d5904', 'request_id': 'req-a7a8148b-9fcc-4819-87f2-b0288cb286bc'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:57.044761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8af8fe1a29049eb99cb33410d9d5904', 'request_id': 'req-a7a8148b-9fcc-4819-87f2-b0288cb286bc'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:57.058211 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8af8fe1a29049eb99cb33410d9d5904', 'request_id': 'req-a7a8148b-9fcc-4819-87f2-b0288cb286bc'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:57.151333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] The token cache is being invalidate because project e8af8fe1a29049eb99cb33410d9d5904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:16:57.151988 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:57.152326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-a7a8148b-9fcc-4819-87f2-b0288cb286bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:16:57.153933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 566/1127] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 23:16:56 2022] DELETE /identity/v3/projects/e8af8fe1a29049eb99cb33410d9d5904 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:17:06.369149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:07.148139 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:20.257481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4822cd-ff6b-42f3-94b0-662bfb78da60 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:20.258481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4822cd-ff6b-42f3-94b0-662bfb78da60 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:20.258481 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4822cd-ff6b-42f3-94b0-662bfb78da60 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:20.259361 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 562/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:20.264130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35831eb-4ecd-4389-8386-08e2cf320b77 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:20.264582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35831eb-4ecd-4389-8386-08e2cf320b77 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:20.264686 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35831eb-4ecd-4389-8386-08e2cf320b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:20.284007 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-c35831eb-4ecd-4389-8386-08e2cf320b77 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:20.285452 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-c35831eb-4ecd-4389-8386-08e2cf320b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:20.346476 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 567/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:18:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:20.512133 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4822cd-ff6b-42f3-94b0-662bfb78da60 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:20.512133 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-8a4822cd-ff6b-42f3-94b0-662bfb78da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:20.579974 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4822cd-ff6b-42f3-94b0-662bfb78da60 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:20.584909 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162a3c5-5ac3-4e32-ad0e-30aae37a08fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:20.593021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162a3c5-5ac3-4e32-ad0e-30aae37a08fc service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:20.593021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162a3c5-5ac3-4e32-ad0e-30aae37a08fc service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:20.593021 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162a3c5-5ac3-4e32-ad0e-30aae37a08fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:20.595226 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162a3c5-5ac3-4e32-ad0e-30aae37a08fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:20.596801 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162a3c5-5ac3-4e32-ad0e-30aae37a08fc service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:20.607334 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 563/1130] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:21.440511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47c93-575d-4462-8a66-6c84aa4428e2 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:21.441070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47c93-575d-4462-8a66-6c84aa4428e2 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:21.441070 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47c93-575d-4462-8a66-6c84aa4428e2 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:21.442434 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 568/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:21.447518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c523-c1f8-4b7e-90c8-e2eac2f390f3 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:21.447968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c523-c1f8-4b7e-90c8-e2eac2f390f3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:21.448065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c523-c1f8-4b7e-90c8-e2eac2f390f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:21.467576 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-3025c523-c1f8-4b7e-90c8-e2eac2f390f3 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:21.468768 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3025c523-c1f8-4b7e-90c8-e2eac2f390f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:21.476341 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 564/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:18:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:21.634630 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e47c93-575d-4462-8a66-6c84aa4428e2 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:21.649748 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e47c93-575d-4462-8a66-6c84aa4428e2 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:21.654791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd5c9d-62f0-4db6-94e7-e224348235e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:21.655402 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5c9d-62f0-4db6-94e7-e224348235e4 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:21.655678 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5c9d-62f0-4db6-94e7-e224348235e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:21.655950 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd5c9d-62f0-4db6-94e7-e224348235e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:21.664614 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd5c9d-62f0-4db6-94e7-e224348235e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:21.666219 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd5c9d-62f0-4db6-94e7-e224348235e4 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:21.675589 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 569/1133] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:26.291523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ba8c-1abf-4761-b8fd-a5c3a03edc86 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:26.291944 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ba8c-1abf-4761-b8fd-a5c3a03edc86 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:26.292078 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518ba8c-1abf-4761-b8fd-a5c3a03edc86 None None] PATH_INFO: `/v3` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:26.293348 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 565/1134] 10.222.0.49 () {54 vars in 925 bytes} [Mon Jul 25 23:18:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:18:26.301508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046640f-b81e-48ec-8e67-ab0909ded629 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:26.301508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046640f-b81e-48ec-8e67-ab0909ded629 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:26.301508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046640f-b81e-48ec-8e67-ab0909ded629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:26.331594 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-7046640f-b81e-48ec-8e67-ab0909ded629 None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:26.332794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-7046640f-b81e-48ec-8e67-ab0909ded629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:26.394982 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 570/1135] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 25 23:18:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:30.696466 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ffed5-737d-4c9d-a144-737773ab472f None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:30.697080 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ffed5-737d-4c9d-a144-737773ab472f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:30.697184 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ffed5-737d-4c9d-a144-737773ab472f None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:30.698758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 566/1136] 10.222.0.48 () {54 vars in 961 bytes} [Mon Jul 25 23:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:30.703978 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b12595-caee-44f7-9b42-80230a1f1bec None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:30.704426 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b12595-caee-44f7-9b42-80230a1f1bec None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:30.704529 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b12595-caee-44f7-9b42-80230a1f1bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:30.723813 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-54b12595-caee-44f7-9b42-80230a1f1bec None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:30.725004 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-54b12595-caee-44f7-9b42-80230a1f1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:30.734419 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 571/1137] 10.222.0.48 () {58 vars in 1058 bytes} [Mon Jul 25 23:18:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:18:30.741753 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ffed5-737d-4c9d-a144-737773ab472f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:30.755728 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ffed5-737d-4c9d-a144-737773ab472f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:30.760798 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4109b-73bd-4cfc-b598-8d10f68c6da2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fad215896be49bca76dd44ccb1bdb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:30.761391 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4109b-73bd-4cfc-b598-8d10f68c6da2 service placement] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:30.761669 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4109b-73bd-4cfc-b598-8d10f68c6da2 service placement] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:30.761940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4109b-73bd-4cfc-b598-8d10f68c6da2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:30.770068 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4109b-73bd-4cfc-b598-8d10f68c6da2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:30.771678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4109b-73bd-4cfc-b598-8d10f68c6da2 service placement] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:30.781574 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 567/1138] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:32.934290 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73ebf-3e8f-4239-94d1-37f6eea21850 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:32.934855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73ebf-3e8f-4239-94d1-37f6eea21850 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:32.934855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73ebf-3e8f-4239-94d1-37f6eea21850 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:32.936215 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:32.941157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86882a-0986-43ad-baaa-3d59b9708b55 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:32.941552 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86882a-0986-43ad-baaa-3d59b9708b55 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:32.941706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86882a-0986-43ad-baaa-3d59b9708b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:32.961223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fb86882a-0986-43ad-baaa-3d59b9708b55 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:32.962485 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fb86882a-0986-43ad-baaa-3d59b9708b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:32.970914 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:18:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:33.132337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73ebf-3e8f-4239-94d1-37f6eea21850 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:33.146656 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73ebf-3e8f-4239-94d1-37f6eea21850 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:33.152304 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc524da-acf9-497b-871e-956520ff4272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:33.152912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc524da-acf9-497b-871e-956520ff4272 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:33.153195 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc524da-acf9-497b-871e-956520ff4272 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:33.153474 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc524da-acf9-497b-871e-956520ff4272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:33.161859 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc524da-acf9-497b-871e-956520ff4272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:33.163626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc524da-acf9-497b-871e-956520ff4272 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:33.173771 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 573/1141] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:34.003100 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d190d0-4f40-4afc-bc1c-5447c0333091 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:34.003666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d190d0-4f40-4afc-bc1c-5447c0333091 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:34.003666 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d190d0-4f40-4afc-bc1c-5447c0333091 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:34.005292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 23:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:34.010083 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf0a56-4790-4cf0-9fa5-32768f7025ae None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:34.010643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf0a56-4790-4cf0-9fa5-32768f7025ae None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:34.010643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf0a56-4790-4cf0-9fa5-32768f7025ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:34.030783 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-83cf0a56-4790-4cf0-9fa5-32768f7025ae None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:34.032193 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-83cf0a56-4790-4cf0-9fa5-32768f7025ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:34.042542 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 23:18:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:34.200245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d190d0-4f40-4afc-bc1c-5447c0333091 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:34.213804 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d190d0-4f40-4afc-bc1c-5447c0333091 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:34.218648 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181ea29-fa75-4743-9957-2d9a2b190682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:34.219246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181ea29-fa75-4743-9957-2d9a2b190682 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:34.219525 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181ea29-fa75-4743-9957-2d9a2b190682 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:34.219797 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181ea29-fa75-4743-9957-2d9a2b190682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:34.227706 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181ea29-fa75-4743-9957-2d9a2b190682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:34.229495 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181ea29-fa75-4743-9957-2d9a2b190682 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:34.238710 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 570/1144] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:38.432441 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94f4c-1ea5-4aac-9fcc-8a4c9e8f3551 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:38.433053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94f4c-1ea5-4aac-9fcc-8a4c9e8f3551 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:38.433053 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94f4c-1ea5-4aac-9fcc-8a4c9e8f3551 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:38.434373 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:38.439568 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987caf-240a-46c2-85e9-83292007525b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:38.439977 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987caf-240a-46c2-85e9-83292007525b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:38.440122 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987caf-240a-46c2-85e9-83292007525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:38.459054 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f4987caf-240a-46c2-85e9-83292007525b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:38.460306 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f4987caf-240a-46c2-85e9-83292007525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:38.468745 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:18:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:38.508110 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94f4c-1ea5-4aac-9fcc-8a4c9e8f3551 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:38.509871 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-fca94f4c-1ea5-4aac-9fcc-8a4c9e8f3551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:38.561907 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=100 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:38.566862 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94f4c-1ea5-4aac-9fcc-8a4c9e8f3551 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:38.570289 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648140a1-3c5e-4e5e-ba71-a006958f974c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:38.580896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648140a1-3c5e-4e5e-ba71-a006958f974c service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:38.580896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648140a1-3c5e-4e5e-ba71-a006958f974c service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:38.580896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648140a1-3c5e-4e5e-ba71-a006958f974c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:38.580896 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648140a1-3c5e-4e5e-ba71-a006958f974c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:38.581823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648140a1-3c5e-4e5e-ba71-a006958f974c service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:38.593765 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 576/1147] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:40.833090 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70275-1bc7-4d6b-9619-611c32361bd5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:40.833649 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70275-1bc7-4d6b-9619-611c32361bd5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:40.833649 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70275-1bc7-4d6b-9619-611c32361bd5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:40.835020 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 572/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:40.840725 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fe970-2f49-4a9f-8f20-b678fb14a63c None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:40.841221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fe970-2f49-4a9f-8f20-b678fb14a63c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:40.841335 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fe970-2f49-4a9f-8f20-b678fb14a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:40.861341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-f16fe970-2f49-4a9f-8f20-b678fb14a63c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:40.862551 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f16fe970-2f49-4a9f-8f20-b678fb14a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:40.870639 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 577/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:18:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:40.907862 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70275-1bc7-4d6b-9619-611c32361bd5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:40.909535 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-41c70275-1bc7-4d6b-9619-611c32361bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:40.923323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70275-1bc7-4d6b-9619-611c32361bd5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:40.926778 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4d1a-50ec-47fb-849d-26251da70730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:40.927373 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4d1a-50ec-47fb-849d-26251da70730 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:40.927672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4d1a-50ec-47fb-849d-26251da70730 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:40.927943 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4d1a-50ec-47fb-849d-26251da70730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:40.936641 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4d1a-50ec-47fb-849d-26251da70730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:40.938031 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4d1a-50ec-47fb-849d-26251da70730 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:40.947673 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 573/1150] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:18:44.773582 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aeedf-d455-4052-9596-36ae0c0e46e3 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:44.774155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aeedf-d455-4052-9596-36ae0c0e46e3 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:44.774256 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aeedf-d455-4052-9596-36ae0c0e46e3 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:44.775670 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 578/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:44.781054 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e25d4-b49f-49dd-bf53-b779f818c810 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:44.781490 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e25d4-b49f-49dd-bf53-b779f818c810 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:44.781727 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e25d4-b49f-49dd-bf53-b779f818c810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:44.801966 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c33e25d4-b49f-49dd-bf53-b779f818c810 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:44.803208 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c33e25d4-b49f-49dd-bf53-b779f818c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:44.811584 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 574/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:18:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:45.084933 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aeedf-d455-4052-9596-36ae0c0e46e3 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:45.086763 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f16aeedf-d455-4052-9596-36ae0c0e46e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:45.152727 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aeedf-d455-4052-9596-36ae0c0e46e3 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:45.160880 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d66d3-1d66-444c-8a28-744e1413a8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240ff8f23838441aa25ca1cf766c7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:45.161508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d66d3-1d66-444c-8a28-744e1413a8dd service cinder] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:45.161790 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d66d3-1d66-444c-8a28-744e1413a8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:45.162060 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d66d3-1d66-444c-8a28-744e1413a8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:45.179265 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d66d3-1d66-444c-8a28-744e1413a8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:45.180706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d66d3-1d66-444c-8a28-744e1413a8dd service cinder] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:45.198758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 579/1153] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:47.466128 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5f9f-cca4-4b49-972f-bb47b1ee74e9 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:47.466738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5f9f-cca4-4b49-972f-bb47b1ee74e9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:47.466738 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5f9f-cca4-4b49-972f-bb47b1ee74e9 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:47.468055 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 575/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 23:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:18:47.473432 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832517-4596-47b7-9523-ac9c8a83de76 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:47.473869 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832517-4596-47b7-9523-ac9c8a83de76 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:47.473992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832517-4596-47b7-9523-ac9c8a83de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:47.493521 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-76832517-4596-47b7-9523-ac9c8a83de76 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:18:47.495353 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-76832517-4596-47b7-9523-ac9c8a83de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:47.503332 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 580/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 23:18:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:18:47.777049 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5f9f-cca4-4b49-972f-bb47b1ee74e9 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:18:47.778749 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3f5d5f9f-cca4-4b49-972f-bb47b1ee74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:18:47.786385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=63 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:47.791997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5f9f-cca4-4b49-972f-bb47b1ee74e9 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:18:47.795569 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8bc4f-ae81-4b70-b53e-9ab6810ee9be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240ff8f23838441aa25ca1cf766c7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:18:47.796216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8bc4f-ae81-4b70-b53e-9ab6810ee9be service cinder] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:18:47.796492 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8bc4f-ae81-4b70-b53e-9ab6810ee9be service cinder] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:18:47.796788 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8bc4f-ae81-4b70-b53e-9ab6810ee9be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:18:47.805568 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8bc4f-ae81-4b70-b53e-9ab6810ee9be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:18:47.809595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8bc4f-ae81-4b70-b53e-9ab6810ee9be service cinder] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:18:47.816365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 576/1156] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:18:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:18:57.488181 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=37 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:57.832192 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=5 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:07.748033 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb59d0-365d-4e56-ab6c-60c947789c4b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.748660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb59d0-365d-4e56-ab6c-60c947789c4b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.748660 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb59d0-365d-4e56-ab6c-60c947789c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.770170 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-9fbb59d0-365d-4e56-ab6c-60c947789c4b None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:07.771415 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-9fbb59d0-365d-4e56-ab6c-60c947789c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:07.778784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582b03-bc8b-4c00-8966-6918dc85f205 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.779339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582b03-bc8b-4c00-8966-6918dc85f205 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.779339 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582b03-bc8b-4c00-8966-6918dc85f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.779666 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 581/1157] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:07.790552 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.790840 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.791120 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.800980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-ee582b03-bc8b-4c00-8966-6918dc85f205 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:07.802177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-ee582b03-bc8b-4c00-8966-6918dc85f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:07.810555 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 577/1158] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:07.819901 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.820182 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.820458 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.841805 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:07.842996 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:07.851680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:07.856547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:07.866958 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c3ef-a13e-4f86-8d5c-2801e8a983ec None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:07.871795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:07.872438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.872720 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.872996 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.873717 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:20:07.874023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:07.875097 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:20:07.875097 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:20:07.875097 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:20:07.875986 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:07.889243 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 579/1160] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 23:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:20:07.897484 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:07.908309 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e0ba6-bd06-4c71-abff-6ed43102f073 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:07.913287 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:07.913922 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.914207 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.915139 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.915833 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:07.917743 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:07.935811 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:07.937017 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:07.944866 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 582/1161] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:07.949379 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:07.962890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d418f-1254-46c9-8842-408c66c5aa3c None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:07.963081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:07.963515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:07.963794 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:07.964065 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] PATH_INFO: `/v3/domains` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:07.964742 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:20:07.965037 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:07.966635 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:07.978992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 583/1162] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 23:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:20:07.987851 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:07.997308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c6493-3202-4f7d-b771-fa3990d7ca47 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.002189 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.002823 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.003105 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.003382 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] PATH_INFO: `/v3/projects` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.004043 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.005034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:20:08.005034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:20:08.005034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:20:08.006216 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.056257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 580/1163] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 23:20:07 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:20:08.060588 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.102738 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 584/1164] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 23:20:07 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:20:08.107018 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.122712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1ce9-9dec-4e83-93e6-f6776e382108 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.168252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344ffa-72b7-4bf7-a8ea-88fe2517003d admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.173326 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.173948 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.174231 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.174538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.175199 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.177101 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.187496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.187496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.187496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.187496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.187968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.187968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:20:08.187968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:20:08.187968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:20:08.187968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.255147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 585/1165] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:20:08 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:20:08.259133 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.269847 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 581/1166] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:20:08 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:20:08.270472 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b30553-af79-49ea-8291-86fab63af785 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.271358 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.275141 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.275793 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.276100 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.276511 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.277208 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.278853 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.283026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3ca83-a3f2-4e30-ad0d-9e42ad135d55 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.288595 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.289270 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.289547 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.289822 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.290556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.291661 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 586/1167] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:20:08.292276 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.295745 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.305424 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 582/1168] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:20:08.314180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf8ada-a71a-4222-be83-5d43101f54c3 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.314180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.314180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.314180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.314637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.314637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.314637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.316992 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.324260 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 587/1169] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:20:08.326574 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda7e0-c210-4521-affa-623bb324d218 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.328712 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.332125 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168a275-f751-4997-94b4-530514563334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.332723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168a275-f751-4997-94b4-530514563334 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.332998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168a275-f751-4997-94b4-530514563334 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.333269 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168a275-f751-4997-94b4-530514563334 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.333949 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168a275-f751-4997-94b4-530514563334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.335557 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168a275-f751-4997-94b4-530514563334 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.338429 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60f081-38fd-461b-a9da-2de860fab1a1 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.343136 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.344376 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.344658 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.344936 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] PATH_INFO: `/v3/projects/f3b631d0d38a460da5467f677cca28c1/users/e2e247f3a1f64b90854fc8dc4f3d7fc0/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.346249 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 583/1170] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:20:08.350383 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168a275-f751-4997-94b4-530514563334 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.360412 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b631d0d38a460da5467f677cca28c1, user_id=e2e247f3a1f64b90854fc8dc4f3d7fc0, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.360572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168a275-f751-4997-94b4-530514563334 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.361319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:20:08.361319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:20:08.361319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:20:08.363281 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8756ce-3cd2-4406-be51-d94f285e79c0 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.365211 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca035-ee40-4ffe-84de-857798122e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.365865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca035-ee40-4ffe-84de-857798122e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.366145 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca035-ee40-4ffe-84de-857798122e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.366456 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca035-ee40-4ffe-84de-857798122e36 admin admin] PATH_INFO: `/v3/projects/55326ffdb18f4765b443c46e0e6f5ab2/users/483284f48b8b4336934f89de70af0120/roles/def5a58760984080ab8717cb294b3f64` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.381257 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca035-ee40-4ffe-84de-857798122e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55326ffdb18f4765b443c46e0e6f5ab2, user_id=483284f48b8b4336934f89de70af0120, role_id=def5a58760984080ab8717cb294b3f64)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.384227 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca035-ee40-4ffe-84de-857798122e36 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.428501 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 588/1171] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:20:08 2022] PUT /identity/v3/projects/f3b631d0d38a460da5467f677cca28c1/users/e2e247f3a1f64b90854fc8dc4f3d7fc0/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:20:08.433575 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.433864 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.434142 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.451732 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 584/1172] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:20:08 2022] PUT /identity/v3/projects/55326ffdb18f4765b443c46e0e6f5ab2/users/483284f48b8b4336934f89de70af0120/roles/def5a58760984080ab8717cb294b3f64 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:20:08.459664 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:08.459664 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:08.461268 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.461556 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.461832 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.469672 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:08.481853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] MFA Rules not processed for user `77aed16721a7465ab3ea6f8255da3959`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:08.483094 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:08.503091 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:08.514297 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 589/1173] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:08.526341 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.543066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 585/1174] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:08.554018 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:08.582446 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12efc9-a16b-4a2f-8508-0d95f57656f7 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.592513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1c65-b442-43a2-874c-30060f923a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.592513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1c65-b442-43a2-874c-30060f923a58 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.592513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1c65-b442-43a2-874c-30060f923a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.592513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1c65-b442-43a2-874c-30060f923a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.602363 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1c65-b442-43a2-874c-30060f923a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.603989 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1c65-b442-43a2-874c-30060f923a58 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.611582 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9da912-209f-416d-b5e1-feb7e3e07ace None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:08.614226 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:08.615047 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 590/1175] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:20:08.615165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:08.615165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:08.615459 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:08.625598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:08.627160 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:08.636698 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 586/1176] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:20:14.904169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:14.904783 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:14.904879 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:14.944392 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] MFA Rules not processed for user `483284f48b8b4336934f89de70af0120`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:14.945670 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:15.026677 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 591/1177] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:14 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:15.031218 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.043164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46699ce-7f13-4241-87de-877e48bc1ace service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.048991 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.049786 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.050140 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.050463 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.051397 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.053365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.168813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 587/1178] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 23:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:20:15.174822 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.188162 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7df50f-49b2-457c-8f49-38be2de5ccf1 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.263314 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.264001 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.264345 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.264718 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.265647 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.269745 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.394362 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 592/1179] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:20:15 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:20:15.398603 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.411286 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf645fa-5e48-407d-bedf-de4ff55be8a4 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.418095 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e616a23-fd88-49f2-8055-a29210bcb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.419234 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616a23-fd88-49f2-8055-a29210bcb05b admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.419695 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616a23-fd88-49f2-8055-a29210bcb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.420246 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616a23-fd88-49f2-8055-a29210bcb05b admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.422164 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616a23-fd88-49f2-8055-a29210bcb05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.424649 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616a23-fd88-49f2-8055-a29210bcb05b admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.437789 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 588/1180] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:20:15.441762 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.452979 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d38e9-f9d2-470c-915c-d41a43542f43 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.457983 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.458915 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.459257 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.459637 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] PATH_INFO: `/v3/projects/b16feeda4e2b4c1c8e86fbccfe2546b4/users/11a54840204a435b9f6539d572ba599b/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.482014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16feeda4e2b4c1c8e86fbccfe2546b4, user_id=11a54840204a435b9f6539d572ba599b, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.482014 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.486539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:15.557843 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.558199 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.558507 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.600185 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 593/1181] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:20:15 2022] PUT /identity/v3/projects/b16feeda4e2b4c1c8e86fbccfe2546b4/users/11a54840204a435b9f6539d572ba599b/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:20:15.600409 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] MFA Rules not processed for user `e2e247f3a1f64b90854fc8dc4f3d7fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:15.601742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:15.603860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.691572 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db1ac9-7810-4b43-b975-4da559e7c7ba admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.697752 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.698706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.699184 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.699633 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] PATH_INFO: `/v3/roles` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.700520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.703316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.711598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 589/1182] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:15 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:15.717391 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 594/1183] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:20:15.719523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.722414 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.726813 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:15.739865 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8249b3-eb16-4d4c-8f7a-17da721ed868 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.739985 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c68e1b-75de-431f-9233-cf2d1cdb631d admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:15.743117 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.743453 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:15.743810 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.744129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.744368 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] PATH_INFO: `/v3/projects/b16feeda4e2b4c1c8e86fbccfe2546b4/users/11a54840204a435b9f6539d572ba599b/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.744609 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:15.744987 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:15.745376 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:15.746197 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.746479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16feeda4e2b4c1c8e86fbccfe2546b4, user_id=11a54840204a435b9f6539d572ba599b, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:15.749290 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.749784 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:15.762878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 595/1184] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:20:15 2022] PUT /identity/v3/projects/b16feeda4e2b4c1c8e86fbccfe2546b4/users/11a54840204a435b9f6539d572ba599b/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:20:15.874577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:15.876292 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 590/1185] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 23:20:15 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:20:15.973961 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d3ac-5019-4840-bd03-db172d6130d5 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:16.065874 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:16.066646 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:16.067177 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:16.067293 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:16.068028 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:16.070169 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:16.169025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 596/1186] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 23:20:15 2022] POST /identity/v3/users => generated 295 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:20:16.170770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:16.184557 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cd2a8-ae5d-44ed-8946-f4e622db2dd0 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:16.192750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:16.193683 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:16.194117 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:16.195177 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:16.196073 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:16.197988 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:16.226493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 591/1187] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:20:16.227378 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:16.240508 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbf75c-584f-4e6d-b53e-187f2a3d2ff8 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:16.251911 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:16.252621 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:16.252905 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:16.253783 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] PATH_INFO: `/v3/projects/c86c83ba43654ea38855db55b95482c2/users/ffd5d3b71cae44d29f06123f4ea9e371/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:16.269147 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:16.274394 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86c83ba43654ea38855db55b95482c2, user_id=ffd5d3b71cae44d29f06123f4ea9e371, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:16.277445 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:16.352670 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 597/1188] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:20:16 2022] PUT /identity/v3/projects/c86c83ba43654ea38855db55b95482c2/users/ffd5d3b71cae44d29f06123f4ea9e371/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:20:16.356964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:16.368715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891bd5c-2790-4311-883c-31d00a1a0b04 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:16.522506 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6090-4616-42f2-aa97-dfabbaa14333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:16.523157 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6090-4616-42f2-aa97-dfabbaa14333 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:16.523439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6090-4616-42f2-aa97-dfabbaa14333 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:16.523712 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6090-4616-42f2-aa97-dfabbaa14333 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:16.524476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6090-4616-42f2-aa97-dfabbaa14333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:16.526058 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6090-4616-42f2-aa97-dfabbaa14333 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:16.542036 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 592/1189] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 23:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:20:16.542581 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:16.556349 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b1cf-e359-4a0f-9655-d143f6234b14 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:16.561436 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:16.563084 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:16.563371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:16.563653 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] PATH_INFO: `/v3/projects/c86c83ba43654ea38855db55b95482c2/users/ffd5d3b71cae44d29f06123f4ea9e371/roles/b808049b0af24ba79f7b5a53a732242d` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:16.570799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86c83ba43654ea38855db55b95482c2, user_id=ffd5d3b71cae44d29f06123f4ea9e371, role_id=b808049b0af24ba79f7b5a53a732242d)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:16.573503 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:16.589389 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 598/1190] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 23:20:16 2022] PUT /identity/v3/projects/c86c83ba43654ea38855db55b95482c2/users/ffd5d3b71cae44d29f06123f4ea9e371/roles/b808049b0af24ba79f7b5a53a732242d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:20:22.663108 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15262-bc17-4ce8-8615-207c4ed1dc34 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:22.663665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15262-bc17-4ce8-8615-207c4ed1dc34 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:22.663665 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15262-bc17-4ce8-8615-207c4ed1dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:22.713187 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1bb15262-bc17-4ce8-8615-207c4ed1dc34 None None] MFA Rules not processed for user `11a54840204a435b9f6539d572ba599b`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:22.714990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1bb15262-bc17-4ce8-8615-207c4ed1dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:22.814648 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 593/1191] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:22 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:22.828991 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:22.831595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:22.913031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90ac82-7eb0-4e14-a24a-c81dfacffba5 admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:22.917547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b422d3c782ae4b86a3af62a83b2a6489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:22.917547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:22.917547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:22.917848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:22.988057 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:22.989721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:23.000559 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 599/1192] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:22 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:23.429483 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752fa3-9d87-4cc7-8437-059d892af14a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:23.429973 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752fa3-9d87-4cc7-8437-059d892af14a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:23.430645 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752fa3-9d87-4cc7-8437-059d892af14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:23.468338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4e752fa3-9d87-4cc7-8437-059d892af14a None None] MFA Rules not processed for user `ffd5d3b71cae44d29f06123f4ea9e371`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:23.469351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4e752fa3-9d87-4cc7-8437-059d892af14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:23.535077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:23.574758 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 594/1193] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:23 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:23.585340 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:23.598674 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cfd6e-0fb7-4d12-843c-bbfea3b67989 service glance] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:23.602557 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b249f61-01e7-4200-8f1e-50c4d6f4231d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b422d3c782ae4b86a3af62a83b2a6489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:23.603184 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b249f61-01e7-4200-8f1e-50c4d6f4231d service glance] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:23.603467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b249f61-01e7-4200-8f1e-50c4d6f4231d service glance] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:23.603744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b249f61-01e7-4200-8f1e-50c4d6f4231d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:23.701622 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b249f61-01e7-4200-8f1e-50c4d6f4231d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:23.703475 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b249f61-01e7-4200-8f1e-50c4d6f4231d service glance] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:23.715380 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 600/1194] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:23 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:33.307477 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956068-f4fe-443c-963c-d9400a0dbbfa None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:33.308065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956068-f4fe-443c-963c-d9400a0dbbfa None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:33.308065 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af956068-f4fe-443c-963c-d9400a0dbbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:33.327044 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-af956068-f4fe-443c-963c-d9400a0dbbfa None None] MFA Rules not processed for user `483284f48b8b4336934f89de70af0120`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:33.328640 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-af956068-f4fe-443c-963c-d9400a0dbbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:33.335534 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 595/1195] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:20:33 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:33.652706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa55e-5150-49ec-8b90-3e7609b18ad0 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:33.652706 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa55e-5150-49ec-8b90-3e7609b18ad0 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:33.653204 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa55e-5150-49ec-8b90-3e7609b18ad0 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:33.654592 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 601/1196] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 23:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:33.661997 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057451b1-d0b3-4069-b2c3-aeef9bfbc27f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:33.662311 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057451b1-d0b3-4069-b2c3-aeef9bfbc27f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:33.662581 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057451b1-d0b3-4069-b2c3-aeef9bfbc27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:33.684379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-057451b1-d0b3-4069-b2c3-aeef9bfbc27f None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:33.685678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-057451b1-d0b3-4069-b2c3-aeef9bfbc27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:33.711031 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:33.767027 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 596/1197] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 23:20:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:33.773113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29356-3524-4b17-868b-acb8b5cec854 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:33.773404 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29356-3524-4b17-868b-acb8b5cec854 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:33.773828 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29356-3524-4b17-868b-acb8b5cec854 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:33.776321 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 602/1198] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 23:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:33.787755 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ab6a8-6f55-4d90-8395-f402f71890de None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:33.788419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ab6a8-6f55-4d90-8395-f402f71890de None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:33.788935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ab6a8-6f55-4d90-8395-f402f71890de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:33.813096 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e69ab6a8-6f55-4d90-8395-f402f71890de None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:33.814875 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e69ab6a8-6f55-4d90-8395-f402f71890de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:33.824437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 597/1199] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 23:20:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:33.848369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29356-3524-4b17-868b-acb8b5cec854 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:33.850726 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-efb29356-3524-4b17-868b-acb8b5cec854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:33.867769 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29356-3524-4b17-868b-acb8b5cec854 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:33.877680 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1218-9914-4f43-90d2-25f70029d853 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b422d3c782ae4b86a3af62a83b2a6489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:33.878371 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1218-9914-4f43-90d2-25f70029d853 service glance] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:33.878715 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1218-9914-4f43-90d2-25f70029d853 service glance] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:33.879082 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1218-9914-4f43-90d2-25f70029d853 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:33.896000 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1218-9914-4f43-90d2-25f70029d853 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:33.898809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1218-9914-4f43-90d2-25f70029d853 service glance] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:33.921610 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 603/1200] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:34.467835 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88cbeb-271d-450a-93fe-4e541a1a0f83 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:34.468504 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88cbeb-271d-450a-93fe-4e541a1a0f83 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:34.469412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88cbeb-271d-450a-93fe-4e541a1a0f83 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:34.471586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 598/1201] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 23:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:34.480150 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2568bc-e393-47bf-9813-b33d5e226a2b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:34.480690 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2568bc-e393-47bf-9813-b33d5e226a2b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:34.481129 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2568bc-e393-47bf-9813-b33d5e226a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:34.519703 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-ae2568bc-e393-47bf-9813-b33d5e226a2b None None] MFA Rules not processed for user `95dab827e0eb4f28a7fb0fa414a4bb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:34.524366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-ae2568bc-e393-47bf-9813-b33d5e226a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:34.591230 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 604/1202] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 23:20:34 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:34.606165 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88cbeb-271d-450a-93fe-4e541a1a0f83 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:34.619680 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88cbeb-271d-450a-93fe-4e541a1a0f83 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:34.624150 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaba16-9926-4ade-a48d-2b8b35678e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:34.625704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaba16-9926-4ade-a48d-2b8b35678e39 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:34.626231 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaba16-9926-4ade-a48d-2b8b35678e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:34.626684 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaba16-9926-4ade-a48d-2b8b35678e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:34.636180 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaba16-9926-4ade-a48d-2b8b35678e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:34.638528 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaba16-9926-4ade-a48d-2b8b35678e39 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:34.651141 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 599/1203] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:34 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:35.211390 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfcf4f-6f9e-4b9d-b328-66138e71766d None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.211967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfcf4f-6f9e-4b9d-b328-66138e71766d None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.211967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfcf4f-6f9e-4b9d-b328-66138e71766d None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.213762 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 605/1204] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 23:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:35.220365 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60460a5-6996-415d-8d33-0241b91eb95c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.220652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60460a5-6996-415d-8d33-0241b91eb95c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.220976 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60460a5-6996-415d-8d33-0241b91eb95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.237370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ec0c8-7acf-46d5-8e20-907e2fd9e591 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.237753 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ec0c8-7acf-46d5-8e20-907e2fd9e591 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.238039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ec0c8-7acf-46d5-8e20-907e2fd9e591 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.239398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 606/1205] 10.222.0.48 () {54 vars in 961 bytes} [Mon Jul 25 23:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:35.244425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.244781 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.245193 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.245913 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c60460a5-6996-415d-8d33-0241b91eb95c None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:35.247162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c60460a5-6996-415d-8d33-0241b91eb95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:35.258241 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 600/1206] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 23:20:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:35.263704 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888062-4ccd-4f4b-99cb-1393c7b9a556 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.263986 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888062-4ccd-4f4b-99cb-1393c7b9a556 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.264259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888062-4ccd-4f4b-99cb-1393c7b9a556 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.266577 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 601/1207] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 23:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:20:35.269851 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:35.271180 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:35.276710 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.277196 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.277469 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.299893 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:35.301088 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:35.311998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 602/1208] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 23:20:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:35.323906 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:35.334678 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c07e3-7a27-4cfe-823a-6be39c11693b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:35.339066 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffa597-fdf1-43d2-b972-b43e1c3a336d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:35.339682 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffa597-fdf1-43d2-b972-b43e1c3a336d service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.339961 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffa597-fdf1-43d2-b972-b43e1c3a336d service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.340232 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffa597-fdf1-43d2-b972-b43e1c3a336d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.350493 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffa597-fdf1-43d2-b972-b43e1c3a336d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:35.351912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffa597-fdf1-43d2-b972-b43e1c3a336d service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:35.354427 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 607/1209] 10.222.0.48 () {58 vars in 1058 bytes} [Mon Jul 25 23:20:35 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:20:35.355593 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:35.362372 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 603/1210] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:20:35.366878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420402-639c-4ad6-9ee1-0ebbbeed3218 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:35.373221 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fad215896be49bca76dd44ccb1bdb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:35.374217 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:35.374581 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:35.374867 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:35.377187 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:35.391816 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:35.393565 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:35.414369 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 608/1211] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:45.357773 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=64 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:45.399700 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=64 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:46.204853 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c57d-a44c-4942-96c9-813d164ae1a9 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:46.205223 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c57d-a44c-4942-96c9-813d164ae1a9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:46.205508 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c57d-a44c-4942-96c9-813d164ae1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:46.226162 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-db64c57d-a44c-4942-96c9-813d164ae1a9 None None] MFA Rules not processed for user `95dab827e0eb4f28a7fb0fa414a4bb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:46.227399 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-db64c57d-a44c-4942-96c9-813d164ae1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:46.234542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 604/1212] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 25 23:20:46 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:46.246967 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:46.269849 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ceb12-f11a-42ae-bc73-aeb915b38ead service placement] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:46.273567 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dadfc-cffa-49fb-9d4b-a2c6d2d023ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:46.274187 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dadfc-cffa-49fb-9d4b-a2c6d2d023ff service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:46.274520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dadfc-cffa-49fb-9d4b-a2c6d2d023ff service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:46.274799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dadfc-cffa-49fb-9d4b-a2c6d2d023ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:46.282773 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dadfc-cffa-49fb-9d4b-a2c6d2d023ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:46.285008 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dadfc-cffa-49fb-9d4b-a2c6d2d023ff service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:46.293404 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 609/1213] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:46 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:47.199170 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfca4bf-1e07-4e83-8ab4-ec9325426e60 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:47.199779 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfca4bf-1e07-4e83-8ab4-ec9325426e60 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:47.200072 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfca4bf-1e07-4e83-8ab4-ec9325426e60 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:47.203810 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 605/1214] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:20:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:47.212515 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c17ad-3eed-435f-8ad2-763186ba2f08 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:47.213337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c17ad-3eed-435f-8ad2-763186ba2f08 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:47.213337 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c17ad-3eed-435f-8ad2-763186ba2f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:47.245527 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-0b9c17ad-3eed-435f-8ad2-763186ba2f08 None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:47.246805 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-0b9c17ad-3eed-435f-8ad2-763186ba2f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:47.267744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 610/1215] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:20:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:47.314447 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfca4bf-1e07-4e83-8ab4-ec9325426e60 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:47.348114 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfca4bf-1e07-4e83-8ab4-ec9325426e60 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:47.361814 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43fa6-55de-4787-9e3e-b524e5b6a74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:47.363715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43fa6-55de-4787-9e3e-b524e5b6a74d service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:47.363998 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43fa6-55de-4787-9e3e-b524e5b6a74d service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:47.364273 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43fa6-55de-4787-9e3e-b524e5b6a74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:47.400300 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c43fa6-55de-4787-9e3e-b524e5b6a74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:47.403699 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c43fa6-55de-4787-9e3e-b524e5b6a74d service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:47.429076 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 606/1216] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:20:54.299931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4aeb1-a1c2-4c1e-9fa6-850c9812b59f None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:54.300514 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4aeb1-a1c2-4c1e-9fa6-850c9812b59f None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:54.302782 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4aeb1-a1c2-4c1e-9fa6-850c9812b59f None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:54.304643 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 611/1217] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:20:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:20:54.316120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:54.316662 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:54.317625 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:54.348026 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:20:54.349652 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:20:54.359305 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 607/1218] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:20:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:20:54.374447 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4aeb1-a1c2-4c1e-9fa6-850c9812b59f None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:20:54.390379 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4aeb1-a1c2-4c1e-9fa6-850c9812b59f None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:20:54.396172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7f346-9658-4dec-b4b0-941683c62cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:20:54.396172 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f346-9658-4dec-b4b0-941683c62cd0 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:20:54.396469 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f346-9658-4dec-b4b0-941683c62cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:20:54.396756 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f346-9658-4dec-b4b0-941683c62cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:20:54.406719 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7f346-9658-4dec-b4b0-941683c62cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:20:54.408316 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7f346-9658-4dec-b4b0-941683c62cd0 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:20:54.419992 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 612/1219] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:20:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:21:04.341133 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=12 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:04.414860 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=15 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:11.767886 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:11.777190 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1241b-9f9a-4551-9d41-0f89b4f17a23 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:11.781687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57a9bd-4555-43ae-9037-fe04e5a9e815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:11.781687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a9bd-4555-43ae-9037-fe04e5a9e815 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:11.781954 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a9bd-4555-43ae-9037-fe04e5a9e815 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:11.782245 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a9bd-4555-43ae-9037-fe04e5a9e815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:11.792109 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57a9bd-4555-43ae-9037-fe04e5a9e815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:11.793531 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57a9bd-4555-43ae-9037-fe04e5a9e815 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:11.803975 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 608/1220] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:21:11 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:21:17.629855 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbeb0a-b1c3-43f3-a5ee-0712bcd07d12 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:17.630812 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbeb0a-b1c3-43f3-a5ee-0712bcd07d12 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:17.631244 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbeb0a-b1c3-43f3-a5ee-0712bcd07d12 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:17.633081 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 613/1221] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:21:17.649945 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209113-9261-41fe-ae96-cdf86905299e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:17.650545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209113-9261-41fe-ae96-cdf86905299e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:17.650545 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209113-9261-41fe-ae96-cdf86905299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:17.679766 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1f209113-9261-41fe-ae96-cdf86905299e None None] MFA Rules not processed for user `4a37e53e47a342e197a1826fff5ede73`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:21:17.681702 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1f209113-9261-41fe-ae96-cdf86905299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:21:17.692420 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 609/1222] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:21:17 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:21:17.757890 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbeb0a-b1c3-43f3-a5ee-0712bcd07d12 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:21:17.781442 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbeb0a-b1c3-43f3-a5ee-0712bcd07d12 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:21:17.792112 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f57c5-a860-49f6-ac83-109483417f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:21:17.792974 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f57c5-a860-49f6-ac83-109483417f5a service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:21:17.793425 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f57c5-a860-49f6-ac83-109483417f5a service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:21:17.793857 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f57c5-a860-49f6-ac83-109483417f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:21:17.803993 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f57c5-a860-49f6-ac83-109483417f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:21:17.805825 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f57c5-a860-49f6-ac83-109483417f5a service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:21:17.816878 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 614/1223] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:21:17 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:21:27.672168 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=9 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:27.811954 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=6 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:20.944497 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:20.944990 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:20.945077 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:20.973747 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] MFA Rules not processed for user `e2e247f3a1f64b90854fc8dc4f3d7fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:22:20.974985 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:21.002968 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 610/1224] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:22:20 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:22:21.301872 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2754-316f-47c8-b288-36dbea2a727b None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:21.302387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2754-316f-47c8-b288-36dbea2a727b None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:21.302479 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2754-316f-47c8-b288-36dbea2a727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:21.359160 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-151c2754-316f-47c8-b288-36dbea2a727b None None] MFA Rules not processed for user `95dab827e0eb4f28a7fb0fa414a4bb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:22:21.360343 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-151c2754-316f-47c8-b288-36dbea2a727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:21.391610 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 615/1225] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 23:22:21 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:22:21.402818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:22:21.413644 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4158b-089c-4f6b-9359-90a34948fcde None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:22:21.417129 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cde29-a24e-4f68-a8d1-56693eb604ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:22:21.417742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cde29-a24e-4f68-a8d1-56693eb604ed service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:21.418023 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cde29-a24e-4f68-a8d1-56693eb604ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:21.418362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cde29-a24e-4f68-a8d1-56693eb604ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:21.426976 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cde29-a24e-4f68-a8d1-56693eb604ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:22:21.428435 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cde29-a24e-4f68-a8d1-56693eb604ed service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:22:21.436104 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 611/1226] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:22:21 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:22:31.388093 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=28 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:31.432836 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=21 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:22:56.786544 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:22:56.787058 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:22:56.787151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:22:56.805838 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] MFA Rules not processed for user `e2e247f3a1f64b90854fc8dc4f3d7fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:22:56.807075 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:22:56.813889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 616/1227] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:22:56 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:23:06.801030 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=3 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:23:13.034338 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c436b-4d05-46d5-a473-9c68a23028eb None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:23:13.034818 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c436b-4d05-46d5-a473-9c68a23028eb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:23:13.034905 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c436b-4d05-46d5-a473-9c68a23028eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:23:13.054261 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-057c436b-4d05-46d5-a473-9c68a23028eb None None] MFA Rules not processed for user `e2e247f3a1f64b90854fc8dc4f3d7fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:23:13.055478 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-057c436b-4d05-46d5-a473-9c68a23028eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:23:13.062067 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 612/1228] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:23:13 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:23:23.049210 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:23:32.510062 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:23:32.541543 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292a3a-177b-4fa3-a55c-57fd0c2cacb7 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:23:32.546631 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fad215896be49bca76dd44ccb1bdb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:23:32.547252 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:23:32.547533 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:23:32.547809 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:23:32.557069 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:23:32.558688 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:23:32.569848 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 617/1229] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:23:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:23:42.564355 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=13 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:24:32.637332 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c102e7-5566-49c6-8252-b3b07b6d139b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:24:32.637827 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c102e7-5566-49c6-8252-b3b07b6d139b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:24:32.637940 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c102e7-5566-49c6-8252-b3b07b6d139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:24:32.658676 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c0c102e7-5566-49c6-8252-b3b07b6d139b None None] MFA Rules not processed for user `e2e247f3a1f64b90854fc8dc4f3d7fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:24:32.660090 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c0c102e7-5566-49c6-8252-b3b07b6d139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:24:32.667200 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 613/1230] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:24:32 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:24:42.653992 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:24:46.886356 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:24:46.895999 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883423c-ddf4-425c-8e08-e84c7cb68996 service placement] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:24:46.899772 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:24:46.900398 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:24:46.900676 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:24:46.901113 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:24:46.911111 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:24:46.912538 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:24:46.922628 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 618/1231] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:24:46 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:24:56.918310 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=6 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:25:03.492698 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:25:03.493247 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:25:03.493247 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:25:03.513983 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] MFA Rules not processed for user `483284f48b8b4336934f89de70af0120`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:25:03.515216 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:25:03.523323 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 614/1232] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 23:25:03 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:25:13.508487 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:25:22.835151 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:25:22.855450 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2173-8932-44ea-9d80-b682dd11b998 service neutron] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:25:22.861377 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:25:22.861977 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:25:22.862253 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:25:22.862626 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:25:22.870191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:25:22.871768 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:25:22.881520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 619/1233] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:25:22 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:25:32.877754 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=10 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:25:33.921435 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:25:33.931302 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faf2c3-580f-40b1-a0b6-c6e209d71ac3 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:25:33.934828 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:25:33.935438 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:25:33.935715 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:25:33.935988 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:25:33.946363 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:25:33.947761 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:25:33.958439 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 615/1234] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:25:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:25:39.656131 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:25:39.666797 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558678c-27d2-4f4a-af8e-65d6c452a2af service nova] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:25:39.671135 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:25:39.671952 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:25:39.672404 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:25:39.672921 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:25:39.684272 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:25:39.686074 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:25:39.708366 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 620/1235] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:25:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:25:43.953928 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=6 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:25:49.699285 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=6 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:26:02.907120 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:26:02.915723 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aba35-1660-4a25-89a7-787e52c2a99d service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:26:02.920298 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:26:02.920912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:26:02.921190 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:26:02.921472 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:26:02.929496 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:26:02.933431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:26:02.939406 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 616/1236] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:26:02 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:26:12.936312 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=6 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:26:53.676895 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:26:53.694328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c338fe-fbf9-4f72-b7c2-c61b56dcd102 service neutron] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:26:53.703991 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:26:53.704636 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:26:53.704912 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:26:53.705182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:26:53.734010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:26:53.735931 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:26:53.750587 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 621/1237] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:26:53 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:27:03.744067 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=6 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:27:05.776441 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:05.788315 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc0fa-be2b-4d44-b550-c8107f94561b service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:05.793729 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c017e5-731c-44b5-99f3-0991b680288a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:05.796412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c017e5-731c-44b5-99f3-0991b680288a service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:05.796412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c017e5-731c-44b5-99f3-0991b680288a service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:05.796412 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c017e5-731c-44b5-99f3-0991b680288a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:05.803815 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c017e5-731c-44b5-99f3-0991b680288a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:05.805366 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c017e5-731c-44b5-99f3-0991b680288a service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:05.815980 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 617/1238] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:27:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:27:07.817467 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:07.826766 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d02d-e41a-4a43-ae36-f778f08b38b3 service nova] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:07.830307 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d4a8a-fbd9-43d0-97de-05c09082a86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:07.830913 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4a8a-fbd9-43d0-97de-05c09082a86b service neutron] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:07.831191 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4a8a-fbd9-43d0-97de-05c09082a86b service neutron] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:07.831482 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4a8a-fbd9-43d0-97de-05c09082a86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:07.900130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4a8a-fbd9-43d0-97de-05c09082a86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:07.901549 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4a8a-fbd9-43d0-97de-05c09082a86b service neutron] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:07.920225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 622/1239] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:27:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:27:11.666607 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de036a23-8e17-4147-b3fb-cb7404ae78b5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:11.667371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de036a23-8e17-4147-b3fb-cb7404ae78b5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:11.667371 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de036a23-8e17-4147-b3fb-cb7404ae78b5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:11.668691 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 618/1240] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:27:11.700308 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] REQUEST_METHOD: `POST` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:11.700816 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:11.700816 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:11.738959 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.auth.core [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:27:11.740182 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:27:11.748886 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 623/1241] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:27:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:27:11.760351 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de036a23-8e17-4147-b3fb-cb7404ae78b5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:11.773613 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de036a23-8e17-4147-b3fb-cb7404ae78b5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:11.778524 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff113-5c77-4697-8458-142629215497 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fad215896be49bca76dd44ccb1bdb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:11.779123 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff113-5c77-4697-8458-142629215497 service placement] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:11.779402 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff113-5c77-4697-8458-142629215497 service placement] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:11.779675 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff113-5c77-4697-8458-142629215497 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:11.787912 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff113-5c77-4697-8458-142629215497 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:11.789461 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff113-5c77-4697-8458-142629215497 service placement] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:11.799362 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 619/1242] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:27:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:27:15.708039 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:15.718758 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12832a-3318-40eb-829c-64f70ec9b565 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:15.724226 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:15.724573 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:15.724854 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:15.725130 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] PATH_INFO: `/v3/users/483284f48b8b4336934f89de70af0120` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:15.726319 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=483284f48b8b4336934f89de70af0120)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:15.727361 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: WARNING py.warnings [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:27:15.727361 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: warnings.warn(msg) Jul 25 23:27:15.727361 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: Jul 25 23:27:15.728577 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:15.939328 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483284f48b8b4336934f89de70af0120'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:15.939976 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483284f48b8b4336934f89de70af0120'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.002820 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483284f48b8b4336934f89de70af0120'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.004134 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483284f48b8b4336934f89de70af0120'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.015072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483284f48b8b4336934f89de70af0120'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.040667 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 624/1243] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 23:27:15 2022] DELETE /identity/v3/users/483284f48b8b4336934f89de70af0120 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:27:16.302518 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff113-5c77-4697-8458-142629215497 service placement] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:16.309379 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff113-5c77-4697-8458-142629215497 service placement] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:16.368621 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:16.369336 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:16.369622 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:16.370121 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] PATH_INFO: `/v3/projects/55326ffdb18f4765b443c46e0e6f5ab2` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:16.371419 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55326ffdb18f4765b443c46e0e6f5ab2)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:16.372437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:27:16.372437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 25 23:27:16.372437 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: Jul 25 23:27:16.375128 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:16.522346 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55326ffdb18f4765b443c46e0e6f5ab2', 'request_id': 'req-7aedd036-2895-48eb-a9bd-e498e43b9490'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.697542 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55326ffdb18f4765b443c46e0e6f5ab2', 'request_id': 'req-7aedd036-2895-48eb-a9bd-e498e43b9490'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.704686 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55326ffdb18f4765b443c46e0e6f5ab2', 'request_id': 'req-7aedd036-2895-48eb-a9bd-e498e43b9490'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.735964 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] The token cache is being invalidate because project 55326ffdb18f4765b443c46e0e6f5ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:27:16.736259 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.736888 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:16.738602 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 620/1244] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 23:27:16 2022] DELETE /identity/v3/projects/55326ffdb18f4765b443c46e0e6f5ab2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:27:16.742853 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:16.744261 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:27:16.758010 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf435f3-df5c-4f87-b9c0-90f0480270ea admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:16.784443 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:27:16.813520 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:16.814107 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:16.814420 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:16.814701 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] PATH_INFO: `/v3/users/11a54840204a435b9f6539d572ba599b` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:16.815863 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a54840204a435b9f6539d572ba599b)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:16.818344 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:17.041539 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a54840204a435b9f6539d572ba599b'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.042547 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a54840204a435b9f6539d572ba599b'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.110480 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a54840204a435b9f6539d572ba599b'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.111034 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a54840204a435b9f6539d572ba599b'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.118889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a54840204a435b9f6539d572ba599b'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.136590 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 625/1245] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 23:27:16 2022] DELETE /identity/v3/users/11a54840204a435b9f6539d572ba599b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:27:17.409660 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:27:17.411799 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:27:17.425436 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd036-2895-48eb-a9bd-e498e43b9490 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:27:17.475674 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:27:17.484274 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:27:17.484919 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:27:17.485197 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:27:17.485470 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] PATH_INFO: `/v3/projects/b16feeda4e2b4c1c8e86fbccfe2546b4` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:27:17.486746 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16feeda4e2b4c1c8e86fbccfe2546b4)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:27:17.489349 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:27:17.617007 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16feeda4e2b4c1c8e86fbccfe2546b4', 'request_id': 'req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.697390 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16feeda4e2b4c1c8e86fbccfe2546b4', 'request_id': 'req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.703572 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16feeda4e2b4c1c8e86fbccfe2546b4', 'request_id': 'req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.715296 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] The token cache is being invalidate because project b16feeda4e2b4c1c8e86fbccfe2546b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:27:17.715596 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.716247 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:27:17.717770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 621/1246] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 23:27:17 2022] DELETE /identity/v3/projects/b16feeda4e2b4c1c8e86fbccfe2546b4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:27:27.133127 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:27:27.760476 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:28:13.597072 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:13.599020 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:13.680761 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12034dd0-88d7-4e7e-bf80-d8f89150f1ff admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:13.740188 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a37e53e47a342e197a1826fff5ede73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:13.740808 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:13.741085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:13.741361 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:13.743158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:13.801048 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:13.802663 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa51316-3e02-4faa-9327-9daac5bf7f32 service nova] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:13.811469 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 626/1247] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:28:13 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:28:23.807564 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=85 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:28:28.044290 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:28.045795 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:28.117148 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0ca52-a31c-4968-b5e7-3e13e31c46ae admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:28.120720 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95dab827e0eb4f28a7fb0fa414a4bb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:28.121340 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:28.121617 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:28.121896 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:28.123692 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:28.186330 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:28.187771 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c94a1-9cac-498e-9841-9c32b634d9c9 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:28.197931 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 622/1248] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:28:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:28:31.806164 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7f14c-90a7-4f34-b915-d3a8d019ac35 None None] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:31.806698 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7f14c-90a7-4f34-b915-d3a8d019ac35 None None] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:31.806791 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7f14c-90a7-4f34-b915-d3a8d019ac35 None None] PATH_INFO: `/` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:31.808306 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 627/1249] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 23:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:28:31.840597 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:31.841137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:31.841137 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:31.872838 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] MFA Rules not processed for user `1fad215896be49bca76dd44ccb1bdb58`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:28:31.874025 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:31.950770 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 623/1250] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 23:28:31 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:28:31.962493 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7f14c-90a7-4f34-b915-d3a8d019ac35 None None] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:31.964225 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-26f7f14c-90a7-4f34-b915-d3a8d019ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:31.981889 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7f14c-90a7-4f34-b915-d3a8d019ac35 None None] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:31.986920 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fad215896be49bca76dd44ccb1bdb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:31.987648 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] REQUEST_METHOD: `GET` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:31.987990 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:31.988331 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:31.997972 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:31.999721 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:32.010017 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 628/1251] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:28:31 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:28:35.560802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:35.560802 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:35.575568 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b068f44-290f-49fa-a9ea-15b3c55f1bd1 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:35.580102 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:35.580718 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:35.581002 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:35.581276 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] PATH_INFO: `/v3/users/e2e247f3a1f64b90854fc8dc4f3d7fc0` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:35.582473 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e247f3a1f64b90854fc8dc4f3d7fc0)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:35.584535 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:35.611060 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:28:35.807751 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e247f3a1f64b90854fc8dc4f3d7fc0'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:35.885201 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e247f3a1f64b90854fc8dc4f3d7fc0'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:35.885750 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e247f3a1f64b90854fc8dc4f3d7fc0'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:35.886391 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e247f3a1f64b90854fc8dc4f3d7fc0'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:35.893687 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e247f3a1f64b90854fc8dc4f3d7fc0'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:35.911951 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 624/1252] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 23:28:35 2022] DELETE /identity/v3/users/e2e247f3a1f64b90854fc8dc4f3d7fc0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:28:36.139595 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:36.153158 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b666d5-bbd8-48f3-9bc1-1eaae8a9b863 service placement] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:36.211691 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:36.212340 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:36.212623 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:36.212926 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] PATH_INFO: `/v3/projects/f3b631d0d38a460da5467f677cca28c1` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:36.214104 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b631d0d38a460da5467f677cca28c1)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:36.216085 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:36.351709 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b631d0d38a460da5467f677cca28c1', 'request_id': 'req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.360576 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b631d0d38a460da5467f677cca28c1', 'request_id': 'req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.367312 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b631d0d38a460da5467f677cca28c1', 'request_id': 'req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.440901 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] The token cache is being invalidate because project f3b631d0d38a460da5467f677cca28c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:28:36.446212 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.446212 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.446212 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 629/1253] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 23:28:36 2022] DELETE /identity/v3/projects/f3b631d0d38a460da5467f677cca28c1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:28:36.448526 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:36.449935 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:36.464056 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf334-88ab-4ca9-aca8-b88e73f6891a admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:36.522598 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:36.523106 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:36.523385 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:36.523658 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] PATH_INFO: `/v3/users/ffd5d3b71cae44d29f06123f4ea9e371` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:36.524825 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd5d3b71cae44d29f06123f4ea9e371)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:36.526772 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:36.706586 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd5d3b71cae44d29f06123f4ea9e371'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.782514 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd5d3b71cae44d29f06123f4ea9e371'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.783135 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd5d3b71cae44d29f06123f4ea9e371'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.783742 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd5d3b71cae44d29f06123f4ea9e371'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.791659 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd5d3b71cae44d29f06123f4ea9e371'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:36.810600 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 625/1254] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 23:28:36 2022] DELETE /identity/v3/users/ffd5d3b71cae44d29f06123f4ea9e371 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:28:37.052387 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Authenticating user token {{(pid=87490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:37.054799 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.fernet_utils [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:37.068063 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6fa5b-ae23-4300-aa9e-821ef39e07cf admin admin] Validating token access rules against request {{(pid=87490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:37.131042 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77aed16721a7465ab3ea6f8255da3959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fb3fc79734a41949ef7b41a3d86f9ef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:37.131684 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:37.131964 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] SCRIPT_NAME: `/identity` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:37.132240 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] PATH_INFO: `/v3/projects/c86c83ba43654ea38855db55b95482c2` {{(pid=87490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:37.133394 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86c83ba43654ea38855db55b95482c2)` {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:37.135333 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] RBAC: Authorization granted {{(pid=87490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:37.156744 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:28:37.263817 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86c83ba43654ea38855db55b95482c2', 'request_id': 'req-ef92d894-38fe-4a0c-8722-6b91773b6071'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:37.269155 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86c83ba43654ea38855db55b95482c2', 'request_id': 'req-ef92d894-38fe-4a0c-8722-6b91773b6071'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:37.275909 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86c83ba43654ea38855db55b95482c2', 'request_id': 'req-ef92d894-38fe-4a0c-8722-6b91773b6071'} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:37.360140 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] The token cache is being invalidate because project c86c83ba43654ea38855db55b95482c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:28:37.360370 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:37.360950 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG keystone.notifications [None req-ef92d894-38fe-4a0c-8722-6b91773b6071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:28:37.362513 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: [pid: 87490|app: 0|req: 630/1255] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 23:28:37 2022] DELETE /identity/v3/projects/c86c83ba43654ea38855db55b95482c2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:28:38.121224 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:28:38.122740 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:38.141659 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:28:38.192505 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fa336-8354-419e-93dd-df9843199638 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:28:38.254149 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fad215896be49bca76dd44ccb1bdb58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7748d2920dac498f818e384b384de2b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:28:38.254819 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:28:38.255184 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:28:38.255523 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:28:38.259317 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:28:38.270731 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:28:38.272431 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc701-8ca6-4f0e-98cf-48446e836fd2 service placement] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:28:38.285871 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 626/1256] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 23:28:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:28:47.357025 dv-osbrick-849021-3-ceph devstack@keystone.service[87490]: DEBUG dbcounter [-] [87490] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:28:48.279189 dv-osbrick-849021-3-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=51 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}